-- Logs begin at Sun 2022-10-23 19:27:30 UTC, end at Sun 2022-10-23 20:20:32 UTC. -- Oct 23 19:51:50.225794 dv-cinder-862432-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 23 19:51:50.234101 dv-cinder-862432-1-smb devstack@keystone.service[81380]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 23 19:51:50.237248 dv-cinder-862432-1-smb devstack@keystone.service[81380]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 19:51:50 2022] *** Oct 23 19:51:50.237372 dv-cinder-862432-1-smb devstack@keystone.service[81380]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 19:51:50.237488 dv-cinder-862432-1-smb devstack@keystone.service[81380]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 19:51:50.237583 dv-cinder-862432-1-smb devstack@keystone.service[81380]: nodename: dv-cinder-862432-1-smb Oct 23 19:51:50.237681 dv-cinder-862432-1-smb devstack@keystone.service[81380]: machine: x86_64 Oct 23 19:51:50.237774 dv-cinder-862432-1-smb devstack@keystone.service[81380]: clock source: unix Oct 23 19:51:50.237871 dv-cinder-862432-1-smb devstack@keystone.service[81380]: pcre jit disabled Oct 23 19:51:50.237968 dv-cinder-862432-1-smb devstack@keystone.service[81380]: detected number of CPU cores: 4 Oct 23 19:51:50.238070 dv-cinder-862432-1-smb devstack@keystone.service[81380]: current working directory: / Oct 23 19:51:50.238195 dv-cinder-862432-1-smb devstack@keystone.service[81380]: detected binary path: /usr/bin/uwsgi-core Oct 23 19:51:50.238302 dv-cinder-862432-1-smb devstack@keystone.service[81380]: your processes number limit is 47680 Oct 23 19:51:50.238404 dv-cinder-862432-1-smb devstack@keystone.service[81380]: your memory page size is 4096 bytes Oct 23 19:51:50.238504 dv-cinder-862432-1-smb devstack@keystone.service[81380]: detected max file descriptor number: 2048 Oct 23 19:51:50.238627 dv-cinder-862432-1-smb devstack@keystone.service[81380]: lock engine: pthread robust mutexes Oct 23 19:51:50.238829 dv-cinder-862432-1-smb devstack@keystone.service[81380]: thunder lock: enabled Oct 23 19:51:50.238983 dv-cinder-862432-1-smb devstack@keystone.service[81380]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 23 19:51:50.239062 dv-cinder-862432-1-smb devstack@keystone.service[81380]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 19:51:50.277622 dv-cinder-862432-1-smb devstack@keystone.service[81380]: Python main interpreter initialized at 0x5625fa2b79c0 Oct 23 19:51:50.277622 dv-cinder-862432-1-smb devstack@keystone.service[81380]: python threads support enabled Oct 23 19:51:50.277622 dv-cinder-862432-1-smb devstack@keystone.service[81380]: your server socket listen backlog is limited to 100 connections Oct 23 19:51:50.277622 dv-cinder-862432-1-smb devstack@keystone.service[81380]: your mercy for graceful operations on workers is 90 seconds Oct 23 19:51:50.277961 dv-cinder-862432-1-smb devstack@keystone.service[81380]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 19:51:50.278038 dv-cinder-862432-1-smb devstack@keystone.service[81380]: *** Operational MODE: preforking *** Oct 23 19:51:50.278308 dv-cinder-862432-1-smb devstack@keystone.service[81380]: *** uWSGI is running in multiple interpreter mode *** Oct 23 19:51:50.278308 dv-cinder-862432-1-smb devstack@keystone.service[81380]: spawned uWSGI master process (pid: 81380) Oct 23 19:51:50.278509 dv-cinder-862432-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 23 19:51:50.279520 dv-cinder-862432-1-smb devstack@keystone.service[81380]: spawned uWSGI worker 1 (pid: 81390, cores: 1) Oct 23 19:51:50.279520 dv-cinder-862432-1-smb devstack@keystone.service[81380]: spawned uWSGI worker 2 (pid: 81391, cores: 1) Oct 23 19:51:50.279520 dv-cinder-862432-1-smb devstack@keystone.service[81380]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 19:51:54.532723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:51:54.532723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: from cryptography.utils import int_from_bytes Oct 23 19:51:54.533521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:51:54.533521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: from cryptography.utils import int_from_bytes Oct 23 19:51:54.537720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:51:54.537720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: from cryptography.utils import int_from_bytes Oct 23 19:51:54.538232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 19:51:54.538232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: from cryptography.utils import int_from_bytes Oct 23 19:51:54.582700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 19:51:54.582889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 19:51:54.583082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] command line args: [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 19:51:54.583349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 19:51:54.583526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ================================================================================ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 19:51:54.583776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] admin_token = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.584022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config_dir = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.584209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.584389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config_source = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.584567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] debug = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.584763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.585122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.585300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.585548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.585793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.586021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.586223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_config_append = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.586298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 19:51:54.586419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.586495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 19:51:54.586594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_dir = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.586672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] command line args: [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 19:51:54.586765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.586929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 19:51:54.587013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.587110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ================================================================================ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 19:51:54.587251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.587364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] admin_token = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.587450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.587625 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config_dir = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.587789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.587974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.588150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.588322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config_source = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.588489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.588670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] debug = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.588847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.589018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.589217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.589400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.589567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.589735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.589901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.590050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.590273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.590462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.590610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.590780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.590953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_config_append = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_dir = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.591965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.592346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.592346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] publish_errors = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.592596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.592712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.592831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.592955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.593076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.593190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.593331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.593453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.594420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.594557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.594854 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.594981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] standard_threads = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595692 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_journal = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.595924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_json = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.596149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.596283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_stderr = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.596399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.596520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_syslog = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.596640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.596755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.596755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.596755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.596755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.597168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.597324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.597469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] publish_errors = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.597583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.597746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.597863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.597975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.598120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.598244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.598358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.598487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.598609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.598723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.598842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.598962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] standard_threads = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.599081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.599207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.599321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.599436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.599549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.599661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.599661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_journal = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.599870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.599967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_json = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.600067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.600162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_stderr = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.600162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_syslog = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.600341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.600453 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 19:51:54.600550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.600644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.600745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.600841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.600940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.601940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.602848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.603843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.604992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.605108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.605223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.605873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.606402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.606528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.606627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.606721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.606816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.606917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607220 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.607997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.608987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.609104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.609281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.609918 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.610033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.610197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.610371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.610506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.610667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.610781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.610901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611833 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.611947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.612994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613843 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.613956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614093 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614330 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.614922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615616 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.615967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.616899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.617944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.618914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.619949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.620956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.621916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.external = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.622906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.password = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.token = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.623948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.624931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.625089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.625223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.625338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.625540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.625657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.625781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.625902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.626970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.external = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.627995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.password = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.token = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.628810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.629956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.630944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631414 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631531 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.631988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.632907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.633023 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.633137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.633258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.633386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.633648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.633770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.633885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.634857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.635985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.636887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637356 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.637937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.638994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.639921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.640975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.641910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.642995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.643918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.644866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.645986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.646945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.647986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648345 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.648994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.649887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.650955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651078 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.651901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.652945 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.653991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.654965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.655894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.656016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.656653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.656769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.656884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.656998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.657121 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.657237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.657351 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.657464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.657578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.657698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.657886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.658961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.659992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.660918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.661842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.661842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.661842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.661842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.662282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.662398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.662398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.662398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.662727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.662842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.662956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663651 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.663878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.664925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.665883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.666944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667174 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.667980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.668900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.669945 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.670240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.671176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.671176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.671176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.671176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.671176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.671901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.671901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.672268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.672602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.672859 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.673141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.673376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.673623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.673894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.674184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.674433 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.674682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.674922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.675163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.675399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.675635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.675873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.676107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.676352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.676590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.676834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.677067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.677315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.677550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.677793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.678024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.678286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.678521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 19:51:54.680372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 19:51:54.697837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.698067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.698318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.707362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.708165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.708393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.708613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.716925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.736430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.736658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.738025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.738278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.788962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.789918 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.837966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.838219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.839780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.840016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.991915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.992145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.992358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.992576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.992793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:54.993008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.000389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.000626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.000853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.001078 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.001300 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.001520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.016478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.016708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.016898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.016997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017351 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.017863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.018022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.018238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.028967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.029058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.042470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.042580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.042651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.042735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.042868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.042951 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.043824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 19:51:55.060551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.060759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 19:51:55.061049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.061132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.061261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 19:51:55.061359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 19:51:55.061796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.061884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.062040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 19:51:55.062152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.062377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.062640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.062722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.062958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.063038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.063221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.072219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.072497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.072767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.072849 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.073049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.073145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.073327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.073614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.080732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.081108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.083631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.083917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.084036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.084196 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.084324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.084473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.084604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.084753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.084886 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.085011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.085167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.085280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.085428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.085551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.085701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.085935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.086024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.086237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.086319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.086508 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.086589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.086776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.109652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.110217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.111219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.111501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.111679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.111965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.116511 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.116798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.117081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.117783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.118067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.118371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.123567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.123856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.124705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.125177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.127872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.128165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.128454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.128742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.129322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.129612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.129894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.130199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.130481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.130707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.130800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.131002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.131083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.131286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.131364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.131566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.147656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.147932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.148272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.148548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.151752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.152421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.154833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.155135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.155624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.155920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.159667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.160227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.162892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.163372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.165990 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.166406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.166575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.166694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.166874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.167100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.167193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.167384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.167465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.167678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.167758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.167984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.183604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.183893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.183975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.184163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.184244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.184431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.184513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.184690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.191959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.192538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.193619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.194100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.195196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.195478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.195620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.195965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.198232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.198533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.198614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.198818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.198900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.199103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.199249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.199393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.199525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.199797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.210692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.210890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.210981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.211176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.211268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.211514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.211598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.211814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.211898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.212094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.212191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.212380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.212461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.212675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.228303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.228420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.231321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.231412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.234283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.234409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.235907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.236008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.237397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.237491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.237683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.237766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.237975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.238058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.244318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.244537 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.245772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.246014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.248768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.248892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.249058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.249194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.249339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.249482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.249614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.249763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.257896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.258209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.258416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.258501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.258709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.258995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.265963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.266338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 19:51:55.266664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.266815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.266900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.267095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.267188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.267373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.267459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.267648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.267730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.267920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.268013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.268193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.268279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.268480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.268562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.268750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.268830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.269016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.269097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.269281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.269362 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.269561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.269642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.269826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.270107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 19:51:55.303875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625fa2b79c0 pid: 81391 (default app) Oct 23 19:51:55.303975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5625fa2b79c0 pid: 81390 (default app) Oct 23 19:51:55.307135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5749f-5a62-4f20-8322-52854dbabd8b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:51:55.307422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5749f-5a62-4f20-8322-52854dbabd8b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:51:55.307695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5749f-5a62-4f20-8322-52854dbabd8b None None] PATH_INFO: `/v3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:51:55.312076 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Sun Oct 23 19:51:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:02.103048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30498b1c-1a43-4978-92d1-44410b37c94f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:02.103542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30498b1c-1a43-4978-92d1-44410b37c94f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:02.103649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30498b1c-1a43-4978-92d1-44410b37c94f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:02.107831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:52:02.113310 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:02.113746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:02.113885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:02.184248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: INFO dbcounter [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] Registered counter for database keystone Oct 23 19:52:02.204481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG oslo_db.sqlalchemy.engines [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:52:02.210661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writer thread running {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:52:02.392664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG passlib.handlers.bcrypt [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81391) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 19:52:02.392962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG passlib.handlers.bcrypt [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81391) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 19:52:02.451678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:02.453782 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:02.581059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 19:52:02.877616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30498b1c-1a43-4978-92d1-44410b37c94f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:02.948407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: INFO dbcounter [None req-30498b1c-1a43-4978-92d1-44410b37c94f None None] Registered counter for database keystone Oct 23 19:52:02.970233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG oslo_db.sqlalchemy.engines [None req-30498b1c-1a43-4978-92d1-44410b37c94f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 19:52:02.976438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writer thread running {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 19:52:03.097587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30498b1c-1a43-4978-92d1-44410b37c94f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:03.101789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656423c9-4282-426d-afa6-07633ccc0813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:03.102447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656423c9-4282-426d-afa6-07633ccc0813 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:03.102730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656423c9-4282-426d-afa6-07633ccc0813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:03.103003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656423c9-4282-426d-afa6-07633ccc0813 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:03.111917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656423c9-4282-426d-afa6-07633ccc0813 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:03.163760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING keystone.common.rbac_enforcer.enforcer [None req-656423c9-4282-426d-afa6-07633ccc0813 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 19:52:03.164050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656423c9-4282-426d-afa6-07633ccc0813 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:03.174269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Sun Oct 23 19:52:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 19:52:03.180163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:03.197543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054f400-9a59-40cb-89de-d418359ea9ac None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:03.203145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f99da-466f-4fa5-b58f-9bd4d9bd7608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:03.204243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f99da-466f-4fa5-b58f-9bd4d9bd7608 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:03.204527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f99da-466f-4fa5-b58f-9bd4d9bd7608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:03.204805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f99da-466f-4fa5-b58f-9bd4d9bd7608 admin admin] PATH_INFO: `/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:03.208653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f99da-466f-4fa5-b58f-9bd4d9bd7608 admin admin] RBAC: Authorizing `identity:get_project(project_id=91c902e0ebe349a8bcb2a7801a9ea6fd)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:03.260189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d5f99da-466f-4fa5-b58f-9bd4d9bd7608 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 19:52:03.260537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f99da-466f-4fa5-b58f-9bd4d9bd7608 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:03.265042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Sun Oct 23 19:52:03 2022] GET /identity/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:05.409198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ab428-bb1a-4ca2-924c-8f94b814d0fb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:05.409769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ab428-bb1a-4ca2-924c-8f94b814d0fb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:05.409769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ab428-bb1a-4ca2-924c-8f94b814d0fb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:05.413780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:05.419182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92e5d-4eca-4915-a8e0-361aa6477ddc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:05.419567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92e5d-4eca-4915-a8e0-361aa6477ddc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:05.419737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92e5d-4eca-4915-a8e0-361aa6477ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:05.441317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2ef92e5d-4eca-4915-a8e0-361aa6477ddc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:05.442878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2ef92e5d-4eca-4915-a8e0-361aa6477ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:05.450650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 23 19:52:05.725753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ab428-bb1a-4ca2-924c-8f94b814d0fb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:05.738595 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ab428-bb1a-4ca2-924c-8f94b814d0fb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:05.742796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089374d-896b-4690-b9a8-85ca8e455215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:05.743424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089374d-896b-4690-b9a8-85ca8e455215 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:05.743711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089374d-896b-4690-b9a8-85ca8e455215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:05.744273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089374d-896b-4690-b9a8-85ca8e455215 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:05.751863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089374d-896b-4690-b9a8-85ca8e455215 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:05.753636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089374d-896b-4690-b9a8-85ca8e455215 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:05.762338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Sun Oct 23 19:52:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 19:52:05.767746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef92e5d-4eca-4915-a8e0-361aa6477ddc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:05.776665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef92e5d-4eca-4915-a8e0-361aa6477ddc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:05.781497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72890e-ff0d-44b5-9e96-969a7044ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:05.782135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72890e-ff0d-44b5-9e96-969a7044ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:05.782421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72890e-ff0d-44b5-9e96-969a7044ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:05.782698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72890e-ff0d-44b5-9e96-969a7044ca0b admin admin] PATH_INFO: `/v3/users/9ecf283756b744a0810fbf73595c6ce6` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:05.784014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72890e-ff0d-44b5-9e96-969a7044ca0b admin admin] RBAC: Authorizing `identity:get_user(user_id=9ecf283756b744a0810fbf73595c6ce6)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:05.785816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72890e-ff0d-44b5-9e96-969a7044ca0b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:05.787359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Sun Oct 23 19:52:05 2022] GET /identity/v3/users/9ecf283756b744a0810fbf73595c6ce6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:08.025756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9740710-d275-4d4a-a45c-3ee629e0e7a2 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.026289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9740710-d275-4d4a-a45c-3ee629e0e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.026289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9740710-d275-4d4a-a45c-3ee629e0e7a2 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.027622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:08.033671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a7c4-a163-435a-ac65-00ea842fae2a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.034067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a7c4-a163-435a-ac65-00ea842fae2a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.034413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a7c4-a163-435a-ac65-00ea842fae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.035776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082056d9-7449-4d16-8f0e-45d9894146ff None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.036075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082056d9-7449-4d16-8f0e-45d9894146ff None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.036351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082056d9-7449-4d16-8f0e-45d9894146ff None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.037581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:52:08.042563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598807-6f89-413a-9cf3-57971008a483 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.042851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598807-6f89-413a-9cf3-57971008a483 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.043130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598807-6f89-413a-9cf3-57971008a483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.053440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-dfe7a7c4-a163-435a-ac65-00ea842fae2a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:08.054628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dfe7a7c4-a163-435a-ac65-00ea842fae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:08.084874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG passlib.handlers.bcrypt [None req-71598807-6f89-413a-9cf3-57971008a483 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81390) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 19:52:08.085271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG passlib.handlers.bcrypt [None req-71598807-6f89-413a-9cf3-57971008a483 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81390) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 19:52:08.134790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-71598807-6f89-413a-9cf3-57971008a483 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:08.136441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-71598807-6f89-413a-9cf3-57971008a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:08.138460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:08.237379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:08.408338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a7c4-a163-435a-ac65-00ea842fae2a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:08.432327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:08.511751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a7c4-a163-435a-ac65-00ea842fae2a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:08.518195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71598807-6f89-413a-9cf3-57971008a483 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:08.545142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:08.545807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.546104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.547092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.558070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:08.567991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:08.569053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:08.569915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:52:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:08.574824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:08.619517 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71598807-6f89-413a-9cf3-57971008a483 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:08.621823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:08.658567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:08.659369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.659651 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.659922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.660879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:08.661397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:08.662318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:08.673447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.sql.core [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 19:52:08.673447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 19:52:08.673447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [parameters: {'id': 'c524277421144cbda595feea5839d1c6', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 19:52:08.673447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 19:52:08.680352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889ddf-c466-4d0c-9d16-91c910a4865b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:52:08.692468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 19:52:08.693471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application yield resource Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise self.value Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application session.commit() Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 19:52:08.694494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.flush() Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application compat.raise_( Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 19:52:08.695380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 19:52:08.696262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:52:08.697039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [parameters: {'id': 'c524277421144cbda595feea5839d1c6', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 19:52:08.697856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:08.698639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 8/15] 10.222.0.18 () {60 vars in 1137 bytes} [Sun Oct 23 19:52:08 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:08.699711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:08.722452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:08.723073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.723358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.723795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.724316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:08.724689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:08.726042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:08.738526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 8/16] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:08.743989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:08.802992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06f93-60dc-4d5a-8ab8-e4719d1f1af3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:08.835187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:08.836044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.836332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.836610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.841982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7b5b6-3bc9-4d2a-ab6e-2dd893e74a32 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:08.854592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:08.856044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:52:08.872052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:08.872923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:52:08.873721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:52:08.873721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:52:08.873721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:08.873721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:08.876172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:08.876804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:08.877088 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:08.877370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] PATH_INFO: `/v3/users/9ecf283756b744a0810fbf73595c6ce6` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:08.878698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] RBAC: Authorizing `identity:get_user(user_id=9ecf283756b744a0810fbf73595c6ce6)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:08.879049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:08.880153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:08.881731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:08 2022] GET /identity/v3/users/9ecf283756b744a0810fbf73595c6ce6 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:08.886782 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:08.901129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:08.905296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:08.984634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205008-5023-4a85-a275-702c8b615ad7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:08.991067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a2d37-37b2-4abb-973b-5a78e05a0502 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:09.020845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add7647-a438-495b-bdc1-0fcda3a16a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:09.021443 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7647-a438-495b-bdc1-0fcda3a16a8a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:09.021724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7647-a438-495b-bdc1-0fcda3a16a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:09.022000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add7647-a438-495b-bdc1-0fcda3a16a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:09.022739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7647-a438-495b-bdc1-0fcda3a16a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:09.023042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7647-a438-495b-bdc1-0fcda3a16a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:09.024440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add7647-a438-495b-bdc1-0fcda3a16a8a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:09.024628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:09.025226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:09.025504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:09.025777 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:09.026913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:09.028340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:09.029871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:09.036560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:09.041888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:09.126281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:09.147039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79dcb-b68f-423d-ae12-15efb10d9f3e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:09.182759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a09e54-b0d0-4275-8a4d-296339da7f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:09.183431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09e54-b0d0-4275-8a4d-296339da7f7f None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:09.183713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09e54-b0d0-4275-8a4d-296339da7f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:09.183989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a09e54-b0d0-4275-8a4d-296339da7f7f None admin] PATH_INFO: `/v3/domains/default/users/9ecf283756b744a0810fbf73595c6ce6/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:09.185985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a09e54-b0d0-4275-8a4d-296339da7f7f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9ecf283756b744a0810fbf73595c6ce6, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:09.187857 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a09e54-b0d0-4275-8a4d-296339da7f7f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:09.305709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1361 bytes} [Sun Oct 23 19:52:09 2022] PUT /identity/v3/domains/default/users/9ecf283756b744a0810fbf73595c6ce6/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:52:11.801007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5733d0-ce2a-4e0b-bb43-8b8756214c21 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:11.802003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5733d0-ce2a-4e0b-bb43-8b8756214c21 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:11.802508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5733d0-ce2a-4e0b-bb43-8b8756214c21 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:11.804574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:11.816764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e241-6713-42d9-b527-bbc0059152ae None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:11.817674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e241-6713-42d9-b527-bbc0059152ae None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:11.818180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e241-6713-42d9-b527-bbc0059152ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:11.850097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a7b5e241-6713-42d9-b527-bbc0059152ae None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:11.852038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a7b5e241-6713-42d9-b527-bbc0059152ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:11.855777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0f9f-effd-4620-ade0-d2d2fbfb8b0d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:11.856282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0f9f-effd-4620-ade0-d2d2fbfb8b0d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:11.856784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c0f9f-effd-4620-ade0-d2d2fbfb8b0d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:11.858877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 12/23] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:11.876875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fdf6-816a-4fd4-afe2-cc17ea280409 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:11.877514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fdf6-816a-4fd4-afe2-cc17ea280409 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:11.878262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0fdf6-816a-4fd4-afe2-cc17ea280409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:11.908204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5ed0fdf6-816a-4fd4-afe2-cc17ea280409 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:11.910422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5ed0fdf6-816a-4fd4-afe2-cc17ea280409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:11.991211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:11.992595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afca97d-454b-4d8e-9a6b-09afeb4d47f4 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:11.992888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afca97d-454b-4d8e-9a6b-09afeb4d47f4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:11.993265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afca97d-454b-4d8e-9a6b-09afeb4d47f4 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:11.997369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 13/25] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:12.003598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616cd2-36cc-421c-bf17-a8c36765ed9a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:12.003885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616cd2-36cc-421c-bf17-a8c36765ed9a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:12.004159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf616cd2-36cc-421c-bf17-a8c36765ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:12.031472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cf616cd2-36cc-421c-bf17-a8c36765ed9a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:12.032658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cf616cd2-36cc-421c-bf17-a8c36765ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:12.036895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 13/26] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:12.135449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:12.144805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:12.156553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374e3a2-0e82-459c-bc70-06f33768cc28 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:12.157166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374e3a2-0e82-459c-bc70-06f33768cc28 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:12.157642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374e3a2-0e82-459c-bc70-06f33768cc28 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:12.159245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 14/28] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:12.176092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272ad7d-3f07-4687-a4e8-eb880e1e47cc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:12.176384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272ad7d-3f07-4687-a4e8-eb880e1e47cc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:12.176669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272ad7d-3f07-4687-a4e8-eb880e1e47cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:12.214248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5272ad7d-3f07-4687-a4e8-eb880e1e47cc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:12.215443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5272ad7d-3f07-4687-a4e8-eb880e1e47cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:12.299315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374e3a2-0e82-459c-bc70-06f33768cc28 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:12.308697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 15/29] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:12.338456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:12.407839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374e3a2-0e82-459c-bc70-06f33768cc28 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:12.444166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:12.445142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:12.445793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:12.446337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:12.447228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:12.448868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:12.591143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272ad7d-3f07-4687-a4e8-eb880e1e47cc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:12.609422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 15/30] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Oct 23 19:52:12 2022] POST /identity/v3/roles => generated 219 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:52:12.658375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:12.770555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:12.797090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272ad7d-3f07-4687-a4e8-eb880e1e47cc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:12.803624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a88a58-220e-4273-a358-fd50a00ea3ff None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:12.846145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167da1-8461-452f-b535-31357a74af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:12.846145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167da1-8461-452f-b535-31357a74af3a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:12.846398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167da1-8461-452f-b535-31357a74af3a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:12.846589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167da1-8461-452f-b535-31357a74af3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:12.859534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:12.870290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07167da1-8461-452f-b535-31357a74af3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:12.871911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07167da1-8461-452f-b535-31357a74af3a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:12.872851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:12.873694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:12.874142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:12.875122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:12.875953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:12.877628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-07167da1-8461-452f-b535-31357a74af3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:52:12.892993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:12.894359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:52:12.895375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:52:12.895375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:52:12.895375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:12.896803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 16/31] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:12.897716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167da1-8461-452f-b535-31357a74af3a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:12.903805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 16/32] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Oct 23 19:52:12 2022] POST /identity/v3/roles => generated 225 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:12.904861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:13.033912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167da1-8461-452f-b535-31357a74af3a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:13.094539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:13.115487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:13.116148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.116440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.116723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.123624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae5fa-dd66-4b36-b216-a846f3479e29 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:13.146861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:13.153390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:13.154492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:13.156024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:13.158556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 17/33] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:13.165065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:13.190817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:13.191802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.192696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.193163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.194306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:13.194810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:13.197151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:13.220919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:13.227089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:13.299765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7636dad-faaa-4140-90c4-affce1dfc7ab None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:13.301349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:13.350099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:13.350726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.351018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.351300 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.351979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:13.352288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:13.353679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:13.368797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8744fc-a911-4c30-9476-b47771f3fd5e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:13.373821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 18/35] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:13.375582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:13.409914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbca9e-07e8-4f58-83a1-1764839fd932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:13.410769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbca9e-07e8-4f58-83a1-1764839fd932 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.410885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbca9e-07e8-4f58-83a1-1764839fd932 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.411187 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbca9e-07e8-4f58-83a1-1764839fd932 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.411864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbca9e-07e8-4f58-83a1-1764839fd932 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:13.413356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbca9e-07e8-4f58-83a1-1764839fd932 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:13.426431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:13.443770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 18/36] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:52:13 2022] POST /identity/v3/projects => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:13.445120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa512-5e3b-4f20-9246-4c46a9729780 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.445373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa512-5e3b-4f20-9246-4c46a9729780 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.445657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa512-5e3b-4f20-9246-4c46a9729780 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.447257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 19/37] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:13.457784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f85a5-86e2-4d45-a5dc-8907a395a288 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.458114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f85a5-86e2-4d45-a5dc-8907a395a288 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.458419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f85a5-86e2-4d45-a5dc-8907a395a288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.486362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0b8f85a5-86e2-4d45-a5dc-8907a395a288 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:13.487915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0b8f85a5-86e2-4d45-a5dc-8907a395a288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:13.500576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413d45-2ba5-4922-9818-6dbaf09c954f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:13.549415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:13.550785 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.551544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.552092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] PATH_INFO: `/v3/users/9ecf283756b744a0810fbf73595c6ce6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.553926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] RBAC: Authorizing `identity:get_user(user_id=9ecf283756b744a0810fbf73595c6ce6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:13.555710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:13.557819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:13 2022] GET /identity/v3/users/9ecf283756b744a0810fbf73595c6ce6 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:13.565010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:13.588600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 20/39] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:13.693572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d90ed-1e52-4bb8-a190-89807d3b0e88 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:13.700112 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae077-51c2-42ec-926c-45b5e9c367b7 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.700407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae077-51c2-42ec-926c-45b5e9c367b7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.700691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae077-51c2-42ec-926c-45b5e9c367b7 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.703727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 21/40] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:13.707979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb576-f3bf-4273-93f9-e7c339653ecc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.708270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb576-f3bf-4273-93f9-e7c339653ecc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.708551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bb576-f3bf-4273-93f9-e7c339653ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.708724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:13.732917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7d6bb576-f3bf-4273-93f9-e7c339653ecc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:13.734482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7d6bb576-f3bf-4273-93f9-e7c339653ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:13.739223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:13.739865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.740163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.740447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.741588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:13.743077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:13.744645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 20/41] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:13.751075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:13.764075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:13.857949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b70c-5a86-4cfe-af6b-34cc848f2693 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:13.894667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:13.895282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:13.895566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:13.895839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:13.896571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.domain.id=default, user.id=9ecf283756b744a0810fbf73595c6ce6) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:13.896885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:13.898340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:13.907934 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 21/42] 10.222.0.18 () {56 vars in 1322 bytes} [Sun Oct 23 19:52:13 2022] GET /identity/v3/role_assignments?user.id=9ecf283756b744a0810fbf73595c6ce6&scope.domain.id=default&role.id=33f053640f414ee688b1cbf6d6707471 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:13.908725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:13.923451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:13.963052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:14.024979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02dc5-8f6f-4585-9c08-ea2924688444 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:14.063116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:14.063526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:14.063810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:14.064085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:14.065265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:14.066868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:14.068695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 22/44] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:14.074572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb576-f3bf-4273-93f9-e7c339653ecc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:14.183184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bb576-f3bf-4273-93f9-e7c339653ecc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:14.198824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:14.216783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2dd0d-524a-4881-826f-ec9f8b10bfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:14.217395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2dd0d-524a-4881-826f-ec9f8b10bfae None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:14.217681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2dd0d-524a-4881-826f-ec9f8b10bfae None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:14.218507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2dd0d-524a-4881-826f-ec9f8b10bfae None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:14.219152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2dd0d-524a-4881-826f-ec9f8b10bfae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:14.220586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2dd0d-524a-4881-826f-ec9f8b10bfae None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:14.247219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:52:14 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:14.303870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297a94-7251-47c1-85d4-b49b493ac293 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:14.318700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:14.342164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967e3df-b143-4539-8f25-96cba0fd6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:14.342791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e3df-b143-4539-8f25-96cba0fd6014 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:14.343165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e3df-b143-4539-8f25-96cba0fd6014 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:14.343495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e3df-b143-4539-8f25-96cba0fd6014 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:14.344211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967e3df-b143-4539-8f25-96cba0fd6014 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:14.345654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967e3df-b143-4539-8f25-96cba0fd6014 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:14.362235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Oct 23 19:52:14 2022] POST /identity/v3/roles => generated 223 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:52:16.456971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d586e-b80a-4c3d-a36c-1ed10916d0a0 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:16.457485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d586e-b80a-4c3d-a36c-1ed10916d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:16.457566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d586e-b80a-4c3d-a36c-1ed10916d0a0 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:16.458898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:16.464310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d54afc-347e-4a72-ba1e-49ae0a5c8545 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:16.464702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d54afc-347e-4a72-ba1e-49ae0a5c8545 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:16.464872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d54afc-347e-4a72-ba1e-49ae0a5c8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:16.484806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-37d54afc-347e-4a72-ba1e-49ae0a5c8545 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:16.486321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-37d54afc-347e-4a72-ba1e-49ae0a5c8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:16.551288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:16.821805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d586e-b80a-4c3d-a36c-1ed10916d0a0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:16.837843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:16.922043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d586e-b80a-4c3d-a36c-1ed10916d0a0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:16.955629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297fab3-c626-499b-b05a-4741dfd0b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:16.956244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297fab3-c626-499b-b05a-4741dfd0b625 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:16.956524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297fab3-c626-499b-b05a-4741dfd0b625 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:16.956796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297fab3-c626-499b-b05a-4741dfd0b625 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:16.957891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297fab3-c626-499b-b05a-4741dfd0b625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:16.959412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297fab3-c626-499b-b05a-4741dfd0b625 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:16.960956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:16.966557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d54afc-347e-4a72-ba1e-49ae0a5c8545 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:17.062358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d54afc-347e-4a72-ba1e-49ae0a5c8545 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:17.063841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:17.097818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a220923-f17d-4c1d-b314-59bb0f01693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:17.098452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220923-f17d-4c1d-b314-59bb0f01693d None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:17.098743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220923-f17d-4c1d-b314-59bb0f01693d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:17.099025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220923-f17d-4c1d-b314-59bb0f01693d None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:17.099682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220923-f17d-4c1d-b314-59bb0f01693d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:17.101135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220923-f17d-4c1d-b314-59bb0f01693d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:17.126742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1140 bytes} [Sun Oct 23 19:52:16 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:19.266630 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3965fe9-5227-44de-8f04-91bf7eb29713 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:19.267147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3965fe9-5227-44de-8f04-91bf7eb29713 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:19.267230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3965fe9-5227-44de-8f04-91bf7eb29713 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:19.268539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 26/51] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:19.273679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c1c1-8994-43d2-83b7-88c704f681da None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:19.274072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c1c1-8994-43d2-83b7-88c704f681da None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:19.274272 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c1c1-8994-43d2-83b7-88c704f681da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:19.292935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1993c1c1-8994-43d2-83b7-88c704f681da None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:19.294215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1993c1c1-8994-43d2-83b7-88c704f681da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:19.360912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 26/52] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:19.629315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3965fe9-5227-44de-8f04-91bf7eb29713 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:19.710300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:19.729149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3965fe9-5227-44de-8f04-91bf7eb29713 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:19.768495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb88e7-8a97-4e54-a32a-d8cfa5048d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:19.769126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb88e7-8a97-4e54-a32a-d8cfa5048d81 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:19.769412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb88e7-8a97-4e54-a32a-d8cfa5048d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:19.769688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb88e7-8a97-4e54-a32a-d8cfa5048d81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:19.770819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb88e7-8a97-4e54-a32a-d8cfa5048d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:19.772250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb88e7-8a97-4e54-a32a-d8cfa5048d81 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:19.773811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:19.779355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c1c1-8994-43d2-83b7-88c704f681da None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:19.964586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:19.980426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c1c1-8994-43d2-83b7-88c704f681da None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:20.012534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dab1b-087b-4bfd-bab5-8d63ea855249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:20.013136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dab1b-087b-4bfd-bab5-8d63ea855249 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:20.013421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dab1b-087b-4bfd-bab5-8d63ea855249 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:20.013700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dab1b-087b-4bfd-bab5-8d63ea855249 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:20.014372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dab1b-087b-4bfd-bab5-8d63ea855249 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:20.015876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dab1b-087b-4bfd-bab5-8d63ea855249 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:20.041488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 27/54] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:52:19 2022] POST /identity/v3/users => generated 275 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:23.398568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37e762-75d9-4408-a1c1-b0c8173dc314 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.399579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37e762-75d9-4408-a1c1-b0c8173dc314 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.400062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37e762-75d9-4408-a1c1-b0c8173dc314 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.401886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 28/55] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:23.407171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98fec-24b6-4d5b-8f51-843341df7936 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.407587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98fec-24b6-4d5b-8f51-843341df7936 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.407738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98fec-24b6-4d5b-8f51-843341df7936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.433173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cfa98fec-24b6-4d5b-8f51-843341df7936 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:23.434662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cfa98fec-24b6-4d5b-8f51-843341df7936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:23.453842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fafd0-5325-471b-b249-b005c9af9674 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.454381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fafd0-5325-471b-b249-b005c9af9674 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.454900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fafd0-5325-471b-b249-b005c9af9674 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.456449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 29/56] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:23.457717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019013b-da8f-44af-b2bd-cbb49d6554f7 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.458238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019013b-da8f-44af-b2bd-cbb49d6554f7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.458709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019013b-da8f-44af-b2bd-cbb49d6554f7 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.460369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 30/57] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:23.462164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16661dcc-3abb-43a5-9eaf-c8538554776d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.462652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16661dcc-3abb-43a5-9eaf-c8538554776d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.463117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16661dcc-3abb-43a5-9eaf-c8538554776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.481979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-16661dcc-3abb-43a5-9eaf-c8538554776d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:23.484087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-16661dcc-3abb-43a5-9eaf-c8538554776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:23.515741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 28/58] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:23.519305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f4123-aa29-4cea-b406-a2e8926cf572 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.519802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f4123-aa29-4cea-b406-a2e8926cf572 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.520275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f4123-aa29-4cea-b406-a2e8926cf572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.553115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-103f4123-aa29-4cea-b406-a2e8926cf572 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:23.556223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-103f4123-aa29-4cea-b406-a2e8926cf572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:23.579734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:23.696093 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:23.706224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 29/60] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:23.766663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d651d-cf20-4940-a7df-8400f656d755 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.767280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d651d-cf20-4940-a7df-8400f656d755 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.767751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d651d-cf20-4940-a7df-8400f656d755 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.769321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 32/61] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:23.774578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f153a-aad7-4930-a6d9-cd48a4073f01 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:23.775131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f153a-aad7-4930-a6d9-cd48a4073f01 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:23.775605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f153a-aad7-4930-a6d9-cd48a4073f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:23.797858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4e4f153a-aad7-4930-a6d9-cd48a4073f01 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:23.803383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4e4f153a-aad7-4930-a6d9-cd48a4073f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:23.850197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d651d-cf20-4940-a7df-8400f656d755 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:23.908582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 30/62] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:23.909479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f153a-aad7-4930-a6d9-cd48a4073f01 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.003321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.019333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f153a-aad7-4930-a6d9-cd48a4073f01 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.036658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d651d-cf20-4940-a7df-8400f656d755 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.051036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.059186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.060079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.060554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.061037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.073278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:24.079415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:24.080230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:24.080989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:24.088044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 31/63] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:24.088190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.088190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.088190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.088190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.090885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.101021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:24.107424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:24.108856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:24.110352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 33/64] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:52:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:24.112562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.226888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a95-c541-41aa-994e-3053b5e4b380 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.238852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadfd68-341d-4a3e-8038-c74d6cb509ad None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.264396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943646-938f-4825-9e49-64d700341dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.265899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943646-938f-4825-9e49-64d700341dfc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.266209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943646-938f-4825-9e49-64d700341dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.266486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943646-938f-4825-9e49-64d700341dfc None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.267146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da943646-938f-4825-9e49-64d700341dfc None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:24.267454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da943646-938f-4825-9e49-64d700341dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.268830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da943646-938f-4825-9e49-64d700341dfc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.275404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb59b28-551f-4630-87dd-36ffb1f07065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.276030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59b28-551f-4630-87dd-36ffb1f07065 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.276311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59b28-551f-4630-87dd-36ffb1f07065 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.276586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59b28-551f-4630-87dd-36ffb1f07065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.276677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 34/65] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.277452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943646-938f-4825-9e49-64d700341dfc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.279924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.291560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb59b28-551f-4630-87dd-36ffb1f07065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-eeb59b28-551f-4630-87dd-36ffb1f07065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:24.296386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:24.297276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:24.298057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 32/66] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:24.298718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7dac-f913-40ca-84a2-438bc7de1470 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.299119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7dac-f913-40ca-84a2-438bc7de1470 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.299119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7dac-f913-40ca-84a2-438bc7de1470 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.301017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:24.302869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7dac-f913-40ca-84a2-438bc7de1470 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.353207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.381325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da943646-938f-4825-9e49-64d700341dfc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.403838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7dac-f913-40ca-84a2-438bc7de1470 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.415499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.416100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.416379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.416672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.417329 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:24.417629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.419019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.427256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.427256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.444206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.444841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.445125 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.445400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.456644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:24.461471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:24.462406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:24.463194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:24.463810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.494593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.533072 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a81fb-8859-4569-a91a-d30fa2c661d7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.562493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b1126-5eb1-475c-b197-8f18a8fa9791 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.566048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b37205-f52f-4334-a54a-e9eaff642959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.566694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37205-f52f-4334-a54a-e9eaff642959 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.566974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37205-f52f-4334-a54a-e9eaff642959 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.567247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b37205-f52f-4334-a54a-e9eaff642959 None admin] PATH_INFO: `/v3/users/dad3fdbccbf74642b4315d81d91ffd3a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.572817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.580444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b37205-f52f-4334-a54a-e9eaff642959 None admin] RBAC: Authorizing `identity:get_user(user_id=dad3fdbccbf74642b4315d81d91ffd3a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.581881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b37205-f52f-4334-a54a-e9eaff642959 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.583520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/users/dad3fdbccbf74642b4315d81d91ffd3a => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.584635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eed1b6-563b-4bf1-94b9-c4222618bae8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.584913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eed1b6-563b-4bf1-94b9-c4222618bae8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.585206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eed1b6-563b-4bf1-94b9-c4222618bae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.603212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-88eed1b6-563b-4bf1-94b9-c4222618bae8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:24.604430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-88eed1b6-563b-4bf1-94b9-c4222618bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:24.605889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.606726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.607017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.608119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.609873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:24.610453 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.612912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.625759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.626522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.674989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 37/72] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:24.675836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eed1b6-563b-4bf1-94b9-c4222618bae8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.727217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e22ca-803e-4b0c-86a3-d4dfb486d5f1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.738791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.763804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953f16-d932-4730-8315-331b81534015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.765084 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953f16-d932-4730-8315-331b81534015 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.765372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953f16-d932-4730-8315-331b81534015 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.765653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953f16-d932-4730-8315-331b81534015 None admin] PATH_INFO: `/v3/users/dad3fdbccbf74642b4315d81d91ffd3a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.766941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c953f16-d932-4730-8315-331b81534015 None admin] RBAC: Authorizing `identity:get_user(user_id=dad3fdbccbf74642b4315d81d91ffd3a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.768400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c953f16-d932-4730-8315-331b81534015 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.775319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/users/dad3fdbccbf74642b4315d81d91ffd3a => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.775319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953f16-d932-4730-8315-331b81534015 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.792576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eed1b6-563b-4bf1-94b9-c4222618bae8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.820542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.827795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.828412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.828699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.828991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.829651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:24.829959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.831386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.839472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.840265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.893406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953f16-d932-4730-8315-331b81534015 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.931194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.931826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.932112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.932390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.933736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.935024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.937485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.938670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:24.947838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826d1ce-f94e-4ebf-a249-d2f14b3dda6e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:24.962263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:24.982740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:24.983476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:24.983756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:24.984027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] PATH_INFO: `/v3/users/9ecf283756b744a0810fbf73595c6ce6` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:24.985168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] RBAC: Authorizing `identity:get_user(user_id=9ecf283756b744a0810fbf73595c6ce6)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:24.986631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:24.988200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/users/9ecf283756b744a0810fbf73595c6ce6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:24.988961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.046767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1696574-6ca7-4eaa-9a77-b25d959b7b80 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.055469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:25.081714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.082367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.082659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.082935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.084064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.085485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.086150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c048a8-1553-4784-ba9e-cbaeadc1d64d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.087135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 38/77] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:25.090938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.120465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.121084 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.121361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.121658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] PATH_INFO: `/v3/users/dad3fdbccbf74642b4315d81d91ffd3a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.122829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] RBAC: Authorizing `identity:get_user(user_id=dad3fdbccbf74642b4315d81d91ffd3a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.124312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.125881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:24 2022] GET /identity/v3/users/dad3fdbccbf74642b4315d81d91ffd3a => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:25.126673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.177938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:25.189118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727633c-3e81-4625-a83e-d6f5e2df5001 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.222857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.223508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.223795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.224077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f/users/dad3fdbccbf74642b4315d81d91ffd3a/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.226023 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] RBAC: Authorizing `identity:create_grant(project_id=b649cc47a2a94de399da0f23583c766f, user_id=dad3fdbccbf74642b4315d81d91ffd3a, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.227482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.228679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f523f-956b-48bc-8a9c-3cf6cbffd152 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.241584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 39/79] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:25 2022] PUT /identity/v3/projects/b649cc47a2a94de399da0f23583c766f/users/dad3fdbccbf74642b4315d81d91ffd3a/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:25.242221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.276347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.277093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.277447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.277794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.279043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.281051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.282923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 41/80] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:25.284454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:25.287139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.361059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69162ac-21a1-4698-99fd-d1e96314fb26 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.400954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.401598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.401896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.402205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.403403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.404883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.405133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6740ae-8363-450e-ba16-983a084761dd None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.412018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 40/81] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:25 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:25.412018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.430285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:25.449627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.450341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.450624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.450904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f/users/dad3fdbccbf74642b4315d81d91ffd3a/roles/658c99e6ef4841b5844a33d88f1b2d68` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.453761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] RBAC: Authorizing `identity:create_grant(project_id=b649cc47a2a94de399da0f23583c766f, user_id=dad3fdbccbf74642b4315d81d91ffd3a, role_id=658c99e6ef4841b5844a33d88f1b2d68)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.455606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.470158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 42/82] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:25 2022] PUT /identity/v3/projects/b649cc47a2a94de399da0f23583c766f/users/dad3fdbccbf74642b4315d81d91ffd3a/roles/658c99e6ef4841b5844a33d88f1b2d68 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:25.470967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.524124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc09bea-977f-4183-b948-166f7c65f34c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.527776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:25.569765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.570551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.570907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.571259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] PATH_INFO: `/v3/projects/864b96c50f1541519d39bf5f0a82cabd` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.572695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] RBAC: Authorizing `identity:get_project(project_id=864b96c50f1541519d39bf5f0a82cabd)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.574378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.576468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 41/83] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:25 2022] GET /identity/v3/projects/864b96c50f1541519d39bf5f0a82cabd => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:25.582794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.631610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc68c83-de40-49ef-b36f-f1902f774901 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.674386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.675523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.676048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.676464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.677259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.679111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.704149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb0d0-0dba-42f9-b482-4c4354cd1fba None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.713526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 43/84] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:52:25 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:25.714769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:25.753537 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1f55-f418-46eb-b837-c0506b040960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.755795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1f55-f418-46eb-b837-c0506b040960 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.756728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1f55-f418-46eb-b837-c0506b040960 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.758566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1f55-f418-46eb-b837-c0506b040960 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f/users/9ecf283756b744a0810fbf73595c6ce6/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.767166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1f55-f418-46eb-b837-c0506b040960 None admin] RBAC: Authorizing `identity:create_grant(project_id=b649cc47a2a94de399da0f23583c766f, user_id=9ecf283756b744a0810fbf73595c6ce6, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.769198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1f55-f418-46eb-b837-c0506b040960 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.773361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:25.801032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 42/85] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:25 2022] PUT /identity/v3/projects/b649cc47a2a94de399da0f23583c766f/users/9ecf283756b744a0810fbf73595c6ce6/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:25.884642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f019c6-2953-4ba7-8284-bc698defe7be None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:25.940796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f8d7-3a12-4fe9-aa3d-f69e9b1d3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:25.941494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f8d7-3a12-4fe9-aa3d-f69e9b1d3850 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:25.941847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f8d7-3a12-4fe9-aa3d-f69e9b1d3850 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:25.942165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f8d7-3a12-4fe9-aa3d-f69e9b1d3850 None admin] PATH_INFO: `/v3/projects/864b96c50f1541519d39bf5f0a82cabd/users/dad3fdbccbf74642b4315d81d91ffd3a/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:25.944286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f8d7-3a12-4fe9-aa3d-f69e9b1d3850 None admin] RBAC: Authorizing `identity:create_grant(project_id=864b96c50f1541519d39bf5f0a82cabd, user_id=dad3fdbccbf74642b4315d81d91ffd3a, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:25.945810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f8d7-3a12-4fe9-aa3d-f69e9b1d3850 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:25.964070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 44/86] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:25 2022] PUT /identity/v3/projects/864b96c50f1541519d39bf5f0a82cabd/users/dad3fdbccbf74642b4315d81d91ffd3a/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:27.996682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8132fc-0e47-454f-8bec-7af648a09978 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:27.997163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8132fc-0e47-454f-8bec-7af648a09978 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:27.997163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8132fc-0e47-454f-8bec-7af648a09978 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:27.998609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 43/87] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:28.011544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ba3c-1d8f-44de-ac7b-6aa76ab41ab1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:28.011972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ba3c-1d8f-44de-ac7b-6aa76ab41ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:28.012142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ba3c-1d8f-44de-ac7b-6aa76ab41ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:28.034919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6595ba3c-1d8f-44de-ac7b-6aa76ab41ab1 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:28.036144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6595ba3c-1d8f-44de-ac7b-6aa76ab41ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:28.066003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a4173-db32-4612-a9e5-cf82a99181f9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:28.066322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a4173-db32-4612-a9e5-cf82a99181f9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:28.066650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a4173-db32-4612-a9e5-cf82a99181f9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:28.068152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 44/88] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:52:28.073315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000e2f-effd-4b18-b086-499f5aa1cf18 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:28.073860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000e2f-effd-4b18-b086-499f5aa1cf18 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:28.074369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4000e2f-effd-4b18-b086-499f5aa1cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:28.098455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a4000e2f-effd-4b18-b086-499f5aa1cf18 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:28.102923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a4000e2f-effd-4b18-b086-499f5aa1cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:28.138811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:28.162371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 45/89] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:28.204380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:28.599322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ba3c-1d8f-44de-ac7b-6aa76ab41ab1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:28.631264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:28.726263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ba3c-1d8f-44de-ac7b-6aa76ab41ab1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:28.739836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000e2f-effd-4b18-b086-499f5aa1cf18 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:28.796335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747a182-6098-4ab5-ab78-4f932ec86968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:28.797338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a182-6098-4ab5-ab78-4f932ec86968 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:28.797818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a182-6098-4ab5-ab78-4f932ec86968 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:28.798314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a182-6098-4ab5-ab78-4f932ec86968 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:28.815150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a182-6098-4ab5-ab78-4f932ec86968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-4747a182-6098-4ab5-ab78-4f932ec86968 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:28.820789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:28.821627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:28.822420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:28.824629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:52:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:28.826680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd460da-5918-49de-af4d-a9a75f99fbd9 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:28.827908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd460da-5918-49de-af4d-a9a75f99fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:28.828386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd460da-5918-49de-af4d-a9a75f99fbd9 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:28.829845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 47/92] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:28.835359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00ac60-a632-4ee6-b3e4-d119ddc73dc8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:28.835940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00ac60-a632-4ee6-b3e4-d119ddc73dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:28.836602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00ac60-a632-4ee6-b3e4-d119ddc73dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:28.874511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3a00ac60-a632-4ee6-b3e4-d119ddc73dc8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:28.876097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3a00ac60-a632-4ee6-b3e4-d119ddc73dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:28.884149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4000e2f-effd-4b18-b086-499f5aa1cf18 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:28.932704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:28.933354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:28.933645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:28.933929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:28.951455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:28.956466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:28.957329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:28.958108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:28.963486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:28.989158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 48/94] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:28.990198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00ac60-a632-4ee6-b3e4-d119ddc73dc8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:29.016765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.022472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.108009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0f483-6d20-4f2c-bb7e-a0ee60b669d4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.145380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.146017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.146332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.146638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.147372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:29.147686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:29.149166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:29.160599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00ac60-a632-4ee6-b3e4-d119ddc73dc8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.162025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 47/95] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:52:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:29.164898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:29.218960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.219589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.219870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.220145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.220821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:29.221124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:29.222550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:29.231481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:29.236935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:29.256555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.275514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1d5d-3945-4a0a-89e7-f4a2c6b5cb7b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.313466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.314107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.314385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.314666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] PATH_INFO: `/v3/users/dad3fdbccbf74642b4315d81d91ffd3a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.316582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] RBAC: Authorizing `identity:get_user(user_id=dad3fdbccbf74642b4315d81d91ffd3a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:29.318027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:29.322297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:29 2022] GET /identity/v3/users/dad3fdbccbf74642b4315d81d91ffd3a => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:29.329077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:29.365556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.398945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33b5fc-cffb-4b49-af94-2a54ea6b4948 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.463036 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.463917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.464397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.464813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] PATH_INFO: `/v3/users/dad3fdbccbf74642b4315d81d91ffd3a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.467182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] RBAC: Authorizing `identity:get_user(user_id=dad3fdbccbf74642b4315d81d91ffd3a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:29.470739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:29.478651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 50/98] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:29 2022] GET /identity/v3/users/dad3fdbccbf74642b4315d81d91ffd3a => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:29.479701 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:29.519666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf15e1-4e4a-42b7-8d76-888bcb69117d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.556827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b1e74-a9b8-4959-8d3f-525f5cfc0991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.557439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b1e74-a9b8-4959-8d3f-525f5cfc0991 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.557727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b1e74-a9b8-4959-8d3f-525f5cfc0991 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.558008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b1e74-a9b8-4959-8d3f-525f5cfc0991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.581004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.600042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666d87e-06d0-465f-8532-66b9cb2998ed None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.644787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b1e74-a9b8-4959-8d3f-525f5cfc0991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:29.645810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6c5bf-1675-4856-bb41-73720c66e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.646446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b1e74-a9b8-4959-8d3f-525f5cfc0991 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:29.646542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c5bf-1675-4856-bb41-73720c66e75d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.646732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c5bf-1675-4856-bb41-73720c66e75d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.647018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c5bf-1675-4856-bb41-73720c66e75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.663263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.721358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6c5bf-1675-4856-bb41-73720c66e75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:29.722882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6c5bf-1675-4856-bb41-73720c66e75d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:29.749520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 49/99] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 19:52:29.750801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db1b58-a318-4cb3-9b62-9b881df0ef60 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.751091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db1b58-a318-4cb3-9b62-9b881df0ef60 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.751368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db1b58-a318-4cb3-9b62-9b881df0ef60 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.752597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 50/100] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:29.753593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b672a5-6567-4aca-9216-188a90d1ceb7 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.754183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b672a5-6567-4aca-9216-188a90d1ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.754183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b672a5-6567-4aca-9216-188a90d1ceb7 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.755378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 51/101] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:29.759205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b672a5-6567-4aca-9216-188a90d1ceb7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:29.816263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.827571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 51/102] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:52:29.828641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af656-f169-400e-af4d-7cd5035599a4 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.828927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af656-f169-400e-af4d-7cd5035599a4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.829201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af656-f169-400e-af4d-7cd5035599a4 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.830454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 52/103] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:29.835089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726af656-f169-400e-af4d-7cd5035599a4 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:29.868290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b672a5-6567-4aca-9216-188a90d1ceb7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.881519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:29.901933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cb0dd-7d3b-4d0c-9f28-fac0f8d62651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.902595 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb0dd-7d3b-4d0c-9f28-fac0f8d62651 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.902946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb0dd-7d3b-4d0c-9f28-fac0f8d62651 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.903232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cb0dd-7d3b-4d0c-9f28-fac0f8d62651 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.914123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cb0dd-7d3b-4d0c-9f28-fac0f8d62651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d64cb0dd-7d3b-4d0c-9f28-fac0f8d62651 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:29.918921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:29.919891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:29.921204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 52/104] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:29.922448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82027b3-54ee-46d2-8a70-164175e2d1a7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.922448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82027b3-54ee-46d2-8a70-164175e2d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.922570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82027b3-54ee-46d2-8a70-164175e2d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.939858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d82027b3-54ee-46d2-8a70-164175e2d1a7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:29.941055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d82027b3-54ee-46d2-8a70-164175e2d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:29.943413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726af656-f169-400e-af4d-7cd5035599a4 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:29.977687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321c87-5a62-4b02-b483-7cf1fa45aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:29.978343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321c87-5a62-4b02-b483-7cf1fa45aca6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.978626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321c87-5a62-4b02-b483-7cf1fa45aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.978899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321c87-5a62-4b02-b483-7cf1fa45aca6 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:29.980015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0321c87-5a62-4b02-b483-7cf1fa45aca6 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:29.981448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0321c87-5a62-4b02-b483-7cf1fa45aca6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:29.983166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 53/105] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:29 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:29.984274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f95aa-42f5-461c-8c02-be0781a073e7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:29.984615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f95aa-42f5-461c-8c02-be0781a073e7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:29.984906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f95aa-42f5-461c-8c02-be0781a073e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.003183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ca0f95aa-42f5-461c-8c02-be0781a073e7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:30.004381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ca0f95aa-42f5-461c-8c02-be0781a073e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:30.007682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 53/106] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:30.022213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82027b3-54ee-46d2-8a70-164175e2d1a7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.053093 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:30.084343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 54/107] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:30.085666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298b01a-6247-4203-a46c-1c3248f5fdd2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.085962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298b01a-6247-4203-a46c-1c3248f5fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.086272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298b01a-6247-4203-a46c-1c3248f5fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.104001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6298b01a-6247-4203-a46c-1c3248f5fdd2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:30.105191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6298b01a-6247-4203-a46c-1c3248f5fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:30.139804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82027b3-54ee-46d2-8a70-164175e2d1a7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.144975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:30.180240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 55/108] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:30.181146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298b01a-6247-4203-a46c-1c3248f5fdd2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.189373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.190836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.191355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.191836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.194033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:30.196024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:30.198904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 54/109] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:30.199896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.286913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298b01a-6247-4203-a46c-1c3248f5fdd2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.323399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.323980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.324263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.324540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.325205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:30.325580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:30.327450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:30.336011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 56/110] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:30.337173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.339893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0f8a-3e31-4643-9782-4ce28a692f82 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.355475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:30.381425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:30.385645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.386296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.386585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.386865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.387594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] RBAC: Adding query filter params (role.id=658c99e6ef4841b5844a33d88f1b2d68, scope.project.id=b649cc47a2a94de399da0f23583c766f, user.id=dad3fdbccbf74642b4315d81d91ffd3a) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:30.387909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:30.391230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:30.404972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 55/111] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/role_assignments?user.id=dad3fdbccbf74642b4315d81d91ffd3a&scope.project.id=b649cc47a2a94de399da0f23583c766f&role.id=658c99e6ef4841b5844a33d88f1b2d68 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:30.410290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.466350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91997fdd-b3ae-4588-9438-b3cb161bc725 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.517600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.518253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.518537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.518815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.520201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] RBAC: Adding query filter params (role.id=a1d711c0f4c7442ebc3831a3489bcd58, scope.project.id=b649cc47a2a94de399da0f23583c766f, user.id=dad3fdbccbf74642b4315d81d91ffd3a) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:30.520521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:30.522574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:30.533381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 57/112] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/role_assignments?user.id=dad3fdbccbf74642b4315d81d91ffd3a&scope.project.id=b649cc47a2a94de399da0f23583c766f&role.id=a1d711c0f4c7442ebc3831a3489bcd58 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:30.533565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8fe42-bb8e-48f9-ab6c-34453adabe4f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.534351 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.579864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.580533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.580823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.581104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] PATH_INFO: `/v3/users/9ecf283756b744a0810fbf73595c6ce6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.582714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] RBAC: Authorizing `identity:get_user(user_id=9ecf283756b744a0810fbf73595c6ce6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:30.585194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:30.587115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 56/113] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/users/9ecf283756b744a0810fbf73595c6ce6 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:30.588135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.649339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:30.681345 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:30.685893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a989486-4947-4459-b166-8d5e73b2e1fb None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.730601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8b49-9b29-4161-ad93-77c8a4a334f6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.733080 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.733725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.734006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.734308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.735445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:30.736954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:30.743403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 58/114] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:30.744272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.772128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.772771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.773055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.773339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.787425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:30.792807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:30.793808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 57/115] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:30.794871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.863362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16eb6-193e-45e1-a0ec-5daa15b05798 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.896176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de6551-07c8-406d-87da-04f4e3e32220 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:30.896613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.897241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.897538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.897666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:30.897813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.908822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:30.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:30.915171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:30.915958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 59/116] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:30.916582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:30.935722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:30.937102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:30.937461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:30.937811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:30.943272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.004705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.006165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.014160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5da178-680a-40f0-84e9-32306dccd50b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.048615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.049209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.049488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.049767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.050444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.051868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.079004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 60/117] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:52:30 2022] POST /identity/v3/projects => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:31.079843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.118986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 58/118] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:52:31.119867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.122345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.170932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.197860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4bda-7624-413c-ac50-10d38643aa88 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.238063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3bad8-e705-42f7-9a62-fdf7f81f6315 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.238286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.238937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.239245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.239674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.240239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:31.240546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.242030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.252151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 61/119] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:31.253306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.283579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.284561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.284925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.285355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.286038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:31.286404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.288561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.300489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 59/120] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:31.301179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.367133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877ee9-c288-45de-9ac3-b07df6928a9a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.372550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.402046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.402705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.402981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.403255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.404373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.406397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.408029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 62/121] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:31.408789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.419888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb092-dc89-48a8-b5e5-0016fddd9e69 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.420359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.458234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.458962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.459151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.459432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] PATH_INFO: `/v3/users/4016178fe5324ee98058dd1fb5fe08ca` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.475429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=4016178fe5324ee98058dd1fb5fe08ca)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.476890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.479252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/users/4016178fe5324ee98058dd1fb5fe08ca => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:31.479830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.521687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd08d85-2461-4e25-a636-d21c118aafc9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.555606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.556243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.556590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.556931 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] PATH_INFO: `/v3/users/dad3fdbccbf74642b4315d81d91ffd3a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.558154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] RBAC: Authorizing `identity:get_user(user_id=dad3fdbccbf74642b4315d81d91ffd3a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.559660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.561634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/users/dad3fdbccbf74642b4315d81d91ffd3a => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:31.566456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.595919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d6d4-5b79-499c-9008-31c7a3df1bc9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.620066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.637110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.637724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.638012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.638324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.639122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=b649cc47a2a94de399da0f23583c766f, user.id=9ecf283756b744a0810fbf73595c6ce6) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:31.640125 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.642423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.662527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/role_assignments?user.id=9ecf283756b744a0810fbf73595c6ce6&scope.project.id=b649cc47a2a94de399da0f23583c766f&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:31.662527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.662795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.688314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c8a5-92f7-45a7-a9c9-91832d8185d5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.729188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.729997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.730409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.730805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.732203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.735034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.737235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 64/125] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:31.743112 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:31.779411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63966aaf-8c89-4372-810d-456179e697d1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.832369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.833364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.833794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.834283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.865234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ef1e8-81cf-4a32-9ce8-9abd77d238c8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:31.910847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:31.915320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:31.916224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:31.916514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:31.916793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f/users/4016178fe5324ee98058dd1fb5fe08ca/roles/481205a2142b44eab56a5217d0724061` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:31.920098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b649cc47a2a94de399da0f23583c766f, user_id=4016178fe5324ee98058dd1fb5fe08ca, role_id=481205a2142b44eab56a5217d0724061)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.921962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.929920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:31.931665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:31.939452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 65/126] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:31 2022] PUT /identity/v3/projects/b649cc47a2a94de399da0f23583c766f/users/4016178fe5324ee98058dd1fb5fe08ca/roles/481205a2142b44eab56a5217d0724061 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:52:32.059901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 62/127] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:52:32.067687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:32.071736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:32.192214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5912fd-e778-4fc5-abe5-896a92df10a9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:32.228525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d788afb-6a99-4130-8a7d-4c3154525187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:32.229398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d788afb-6a99-4130-8a7d-4c3154525187 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:32.229822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d788afb-6a99-4130-8a7d-4c3154525187 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:32.230291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d788afb-6a99-4130-8a7d-4c3154525187 None admin] PATH_INFO: `/v3/projects/864b96c50f1541519d39bf5f0a82cabd` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:32.231567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d788afb-6a99-4130-8a7d-4c3154525187 None admin] RBAC: Authorizing `identity:get_project(project_id=864b96c50f1541519d39bf5f0a82cabd)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:32.233322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d788afb-6a99-4130-8a7d-4c3154525187 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:32.235800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 66/128] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:32 2022] GET /identity/v3/projects/864b96c50f1541519d39bf5f0a82cabd => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:32.242692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:32.333206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:32.351746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb352145-7084-4ce0-97db-ed7756bf4312 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:32.387626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28259882-f2b8-4455-b85b-d407918c1d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:32.388240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259882-f2b8-4455-b85b-d407918c1d12 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:32.388529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259882-f2b8-4455-b85b-d407918c1d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:32.388839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259882-f2b8-4455-b85b-d407918c1d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:32.390038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259882-f2b8-4455-b85b-d407918c1d12 None admin] RBAC: Adding query filter params (role.id=a1d711c0f4c7442ebc3831a3489bcd58, scope.project.id=864b96c50f1541519d39bf5f0a82cabd, user.id=dad3fdbccbf74642b4315d81d91ffd3a) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:32.390372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259882-f2b8-4455-b85b-d407918c1d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:32.392347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259882-f2b8-4455-b85b-d407918c1d12 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:32.406194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 63/129] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:32 2022] GET /identity/v3/role_assignments?user.id=dad3fdbccbf74642b4315d81d91ffd3a&scope.project.id=864b96c50f1541519d39bf5f0a82cabd&role.id=a1d711c0f4c7442ebc3831a3489bcd58 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:33.459440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ba68-d1db-47bd-a163-31ef745e5fe1 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:33.459951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ba68-d1db-47bd-a163-31ef745e5fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:33.460031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ba68-d1db-47bd-a163-31ef745e5fe1 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:33.461348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 67/130] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:33.466758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185ce6-9f73-49c3-9ce6-40d28e19a420 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:33.467145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185ce6-9f73-49c3-9ce6-40d28e19a420 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:33.467813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185ce6-9f73-49c3-9ce6-40d28e19a420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:33.486013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b4185ce6-9f73-49c3-9ce6-40d28e19a420 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:33.487218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b4185ce6-9f73-49c3-9ce6-40d28e19a420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:33.551464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 64/131] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:33.830432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256ba68-d1db-47bd-a163-31ef745e5fe1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:33.900849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:33.932081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256ba68-d1db-47bd-a163-31ef745e5fe1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:33.964856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e25a3-39a5-4026-8322-d23bb3d04f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:33.965478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e25a3-39a5-4026-8322-d23bb3d04f65 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:33.965759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e25a3-39a5-4026-8322-d23bb3d04f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:33.966033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e25a3-39a5-4026-8322-d23bb3d04f65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:33.967153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e25a3-39a5-4026-8322-d23bb3d04f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:33.969413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e25a3-39a5-4026-8322-d23bb3d04f65 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:33.971013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 68/132] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:33.976600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4185ce6-9f73-49c3-9ce6-40d28e19a420 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:34.057618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:34.078336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4185ce6-9f73-49c3-9ce6-40d28e19a420 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:34.111731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d5f2d-71ad-4779-8f13-15da45f2d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:34.112264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5f2d-71ad-4779-8f13-15da45f2d421 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:34.112548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5f2d-71ad-4779-8f13-15da45f2d421 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:34.112819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5f2d-71ad-4779-8f13-15da45f2d421 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:34.113459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d5f2d-71ad-4779-8f13-15da45f2d421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:34.114923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d5f2d-71ad-4779-8f13-15da45f2d421 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:34.136348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 65/133] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:52:33 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:34.161442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba4c6-6e97-4663-84f8-8503a9fb7916 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:34.161727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba4c6-6e97-4663-84f8-8503a9fb7916 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:34.162006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ba4c6-6e97-4663-84f8-8503a9fb7916 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:34.163419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 69/134] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:34.169448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06fd7b-f183-443d-9175-ef44cb72b17c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:34.169742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06fd7b-f183-443d-9175-ef44cb72b17c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:34.170022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06fd7b-f183-443d-9175-ef44cb72b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:34.189850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2b06fd7b-f183-443d-9175-ef44cb72b17c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:34.191143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2b06fd7b-f183-443d-9175-ef44cb72b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:34.263020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 66/135] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:34.532878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ba4c6-6e97-4663-84f8-8503a9fb7916 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:34.644802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ba4c6-6e97-4663-84f8-8503a9fb7916 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:34.692086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:34.692722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:34.693006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:34.693276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:34.701451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:34.705954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:34.711075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:34.711942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:34.712793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 70/136] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:34.720202 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06fd7b-f183-443d-9175-ef44cb72b17c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:34.789157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:34.827506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06fd7b-f183-443d-9175-ef44cb72b17c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:34.862802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:34.863418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:34.863708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:34.863987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:34.864665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:34.864974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:34.866436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:34.876113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 67/137] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:34.881471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:34.993631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bc6c4-1eec-418c-8913-64b51e9a3066 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:35.029650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:35.031523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:35.031807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:35.032089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] PATH_INFO: `/v3/users/4016178fe5324ee98058dd1fb5fe08ca` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:35.033239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] RBAC: Authorizing `identity:get_user(user_id=4016178fe5324ee98058dd1fb5fe08ca)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:35.034753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:35.036669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 71/138] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:34 2022] GET /identity/v3/users/4016178fe5324ee98058dd1fb5fe08ca => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:35.042117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:35.148037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e2953-6443-4512-bdda-6429ca5b72ac None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:35.178418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:35.188060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:35.188885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:35.189232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:35.189659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:35.260150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:35.261599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:35.368961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 68/139] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:52:35.374899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:35.441619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:35.477612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93510b9c-8f76-4157-97f3-da855c5c8bce None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:35.517129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33593183-ae1d-4ed8-b463-4cd110a50ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:35.517756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593183-ae1d-4ed8-b463-4cd110a50ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:35.518036 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593183-ae1d-4ed8-b463-4cd110a50ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:35.518339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33593183-ae1d-4ed8-b463-4cd110a50ca7 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:35.519465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33593183-ae1d-4ed8-b463-4cd110a50ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:35.520957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33593183-ae1d-4ed8-b463-4cd110a50ca7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:35.522607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 72/140] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:35 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:35.528493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:35.557437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:35.637827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc185f90-e2f1-4488-9b18-e4906d406808 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:35.673804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6a2eb-d263-46ac-ac99-ab720701b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:35.674461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a2eb-d263-46ac-ac99-ab720701b7cf None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:35.674747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a2eb-d263-46ac-ac99-ab720701b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:35.675026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a2eb-d263-46ac-ac99-ab720701b7cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:35.675759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6a2eb-d263-46ac-ac99-ab720701b7cf None admin] RBAC: Adding query filter params (role.id=481205a2142b44eab56a5217d0724061, scope.project.id=b649cc47a2a94de399da0f23583c766f, user.id=4016178fe5324ee98058dd1fb5fe08ca) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:35.676071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6a2eb-d263-46ac-ac99-ab720701b7cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:35.677507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6a2eb-d263-46ac-ac99-ab720701b7cf None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:35.683856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 69/141] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:35 2022] GET /identity/v3/role_assignments?user.id=4016178fe5324ee98058dd1fb5fe08ca&scope.project.id=b649cc47a2a94de399da0f23583c766f&role.id=481205a2142b44eab56a5217d0724061 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:36.534973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1ada-5dd4-4ce5-bf06-be9bcd853da6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:36.535503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1ada-5dd4-4ce5-bf06-be9bcd853da6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:36.535503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1ada-5dd4-4ce5-bf06-be9bcd853da6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:36.536913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 73/142] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:36.542108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0a271-cc41-459d-8781-eb0f1dd73cf4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:36.542518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0a271-cc41-459d-8781-eb0f1dd73cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:36.542723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0a271-cc41-459d-8781-eb0f1dd73cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:36.564882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-67e0a271-cc41-459d-8781-eb0f1dd73cf4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:36.566156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-67e0a271-cc41-459d-8781-eb0f1dd73cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:36.590885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69dc5-add9-4f9e-a9e9-0bb88433df85 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:36.591163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69dc5-add9-4f9e-a9e9-0bb88433df85 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:36.591655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69dc5-add9-4f9e-a9e9-0bb88433df85 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:36.593039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 74/143] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:52:36.598516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1369-c0a5-405a-a3ff-f0805dceba8e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:36.599065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1369-c0a5-405a-a3ff-f0805dceba8e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:36.599534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1369-c0a5-405a-a3ff-f0805dceba8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:36.619467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-23fc1369-c0a5-405a-a3ff-f0805dceba8e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:36.620969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-23fc1369-c0a5-405a-a3ff-f0805dceba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:36.643738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 70/144] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:36.677233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6759-4988-49df-8aa3-136946eb617b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:36.678040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6759-4988-49df-8aa3-136946eb617b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:36.678347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6759-4988-49df-8aa3-136946eb617b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:36.679846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 71/145] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:52:36.684588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ffbf9-7e1e-4ea2-b891-0a4a2a244f04 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:36.684874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ffbf9-7e1e-4ea2-b891-0a4a2a244f04 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:36.685156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ffbf9-7e1e-4ea2-b891-0a4a2a244f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:36.694136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 75/146] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:36.703607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-371ffbf9-7e1e-4ea2-b891-0a4a2a244f04 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:36.704775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-371ffbf9-7e1e-4ea2-b891-0a4a2a244f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:36.722310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:36.773677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 72/147] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:36.947861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1369-c0a5-405a-a3ff-f0805dceba8e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:36.961573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ffbf9-7e1e-4ea2-b891-0a4a2a244f04 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.016276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.052581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1369-c0a5-405a-a3ff-f0805dceba8e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.069436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ffbf9-7e1e-4ea2-b891-0a4a2a244f04 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.087460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.088083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.088359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.088631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.099237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:37.103109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.103735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.104020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.104298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:37.104420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:37.105317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 76/148] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:37.106844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.120634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:37.125574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:37.126499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:37.127286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 73/149] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:52:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:37.129054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.144747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.206129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2601aa-0595-4368-9a63-6d54acce2359 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.229265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23231de-d0fe-4a9b-8988-1e30c3bfe66a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.232457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.241776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.242432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.242740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.243034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.244159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.245609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.247321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 77/150] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:37.248081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.267137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.267732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.268007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.268277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.268932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:37.269233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.270621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.278475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 74/151] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:37.279291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.350416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790286-bee7-4156-9fc4-691718952a8e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.352856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.379820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4d12-79c1-4457-bef5-97ca6212ff90 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.384761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.385358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.385638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.385905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.386598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:37.386896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.388297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.397054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 78/152] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:52:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:37.397845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.414953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.415554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.415829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.416100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.416745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.418184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.440476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 75/153] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:52:37 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:37.441357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.460968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.511080 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f84d4-0563-4aa4-8f70-094e6e43e13d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.547795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.548467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.548718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.548978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] PATH_INFO: `/v3/users/7a4e61679c8a4b3f9797d85430a3b95b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.563546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ae357-9222-46b0-9317-4f29f176baa2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.564116 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] RBAC: Authorizing `identity:get_user(user_id=7a4e61679c8a4b3f9797d85430a3b95b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.565341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.567261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 79/154] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:37 2022] GET /identity/v3/users/7a4e61679c8a4b3f9797d85430a3b95b => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:37.574763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.605296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.614842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.615797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.616762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.617108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] PATH_INFO: `/v3/users/7a4e61679c8a4b3f9797d85430a3b95b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.618346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] RBAC: Authorizing `identity:get_user(user_id=7a4e61679c8a4b3f9797d85430a3b95b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.619820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.621588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 76/155] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:37 2022] GET /identity/v3/users/7a4e61679c8a4b3f9797d85430a3b95b => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:37.627277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.722942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f047f2-0a65-4caa-a27a-d3b0953427c2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.755996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.787852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b390dd-f001-46b2-b0f4-c8b9bcfd571d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:37.798586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.799243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.799527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.799803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.800954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.802446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.804398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 80/156] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:37 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:37.809803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.837031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:37.837679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:37.837965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:37.839082 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:37.839558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:37.841007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:37.844200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 77/157] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:37 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:37.850018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:37.957020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:37.976235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6784c-d1b9-4f45-8fe1-3de1aab91c1d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:38.017258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf749a-fdbd-446c-b96f-8a54742cd3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:38.018300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf749a-fdbd-446c-b96f-8a54742cd3f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:38.018791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf749a-fdbd-446c-b96f-8a54742cd3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:38.019879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf749a-fdbd-446c-b96f-8a54742cd3f1 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/7a4e61679c8a4b3f9797d85430a3b95b/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:38.022132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf749a-fdbd-446c-b96f-8a54742cd3f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d7744e0548a433db28d5f5222cd16a9, user_id=7a4e61679c8a4b3f9797d85430a3b95b, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:38.023768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf749a-fdbd-446c-b96f-8a54742cd3f1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:38.040811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 81/158] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:37 2022] PUT /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/7a4e61679c8a4b3f9797d85430a3b95b/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:38.053352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceced61-7077-4b35-bb24-8464839f2fe8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:38.121595 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9914e-d548-423a-a0be-288f52b2dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:38.126813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9914e-d548-423a-a0be-288f52b2dae4 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:38.127344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9914e-d548-423a-a0be-288f52b2dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:38.127782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9914e-d548-423a-a0be-288f52b2dae4 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/7a4e61679c8a4b3f9797d85430a3b95b/roles/658c99e6ef4841b5844a33d88f1b2d68` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:38.130435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9914e-d548-423a-a0be-288f52b2dae4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d7744e0548a433db28d5f5222cd16a9, user_id=7a4e61679c8a4b3f9797d85430a3b95b, role_id=658c99e6ef4841b5844a33d88f1b2d68)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:38.133586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9914e-d548-423a-a0be-288f52b2dae4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:38.153515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 78/159] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:37 2022] PUT /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/7a4e61679c8a4b3f9797d85430a3b95b/roles/658c99e6ef4841b5844a33d88f1b2d68 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:39.887094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111250-72c6-4f9e-a6ae-f2ea4534dced None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:39.887094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111250-72c6-4f9e-a6ae-f2ea4534dced None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:39.887094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111250-72c6-4f9e-a6ae-f2ea4534dced None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:39.887094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 82/160] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:39.894671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144601-b590-4db2-a668-6989117fcba5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:39.895562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144601-b590-4db2-a668-6989117fcba5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:39.896047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144601-b590-4db2-a668-6989117fcba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:39.912323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94960372-f068-4a21-8dd2-e655f1d3a6eb None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:39.912945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94960372-f068-4a21-8dd2-e655f1d3a6eb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:39.913421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94960372-f068-4a21-8dd2-e655f1d3a6eb None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:39.914992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 83/161] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:39.915755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-37144601-b590-4db2-a668-6989117fcba5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:39.916872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-37144601-b590-4db2-a668-6989117fcba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:39.921789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de644c-e2fd-477b-9c7f-1bc469ad149d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:39.922373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de644c-e2fd-477b-9c7f-1bc469ad149d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:39.922861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de644c-e2fd-477b-9c7f-1bc469ad149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:39.944638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-26de644c-e2fd-477b-9c7f-1bc469ad149d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:39.946295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-26de644c-e2fd-477b-9c7f-1bc469ad149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:39.997496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:40.000164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 79/162] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:40.035929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 84/163] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:40.223240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02312-e7ce-4c40-8b1b-1a02a95a2579 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.223916 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02312-e7ce-4c40-8b1b-1a02a95a2579 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.224426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02312-e7ce-4c40-8b1b-1a02a95a2579 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.225992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 80/164] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:40.231347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249f12-2922-4b76-afc2-773f739bd15c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.231854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249f12-2922-4b76-afc2-773f739bd15c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.232319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249f12-2922-4b76-afc2-773f739bd15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.257319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7e249f12-2922-4b76-afc2-773f739bd15c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:40.259095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7e249f12-2922-4b76-afc2-773f739bd15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:40.278885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02312-e7ce-4c40-8b1b-1a02a95a2579 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.344073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:40.346907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 85/165] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:40.347887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e249f12-2922-4b76-afc2-773f739bd15c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.412458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02312-e7ce-4c40-8b1b-1a02a95a2579 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:40.448774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8de43-7590-46aa-a6e8-6731dabb3aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:40.449394 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8de43-7590-46aa-a6e8-6731dabb3aac None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.449680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8de43-7590-46aa-a6e8-6731dabb3aac None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.449978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8de43-7590-46aa-a6e8-6731dabb3aac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.454642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e249f12-2922-4b76-afc2-773f739bd15c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:40.456612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:40.461901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8de43-7590-46aa-a6e8-6731dabb3aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-77b8de43-7590-46aa-a6e8-6731dabb3aac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:40.466751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:40.467992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:40.469695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 81/166] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:40.474473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4643-5ff7-4911-b5c9-b304d1a2195f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.474769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4643-5ff7-4911-b5c9-b304d1a2195f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.475467 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4643-5ff7-4911-b5c9-b304d1a2195f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.476920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 82/167] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:40.477450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4643-5ff7-4911-b5c9-b304d1a2195f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.498840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cc68b-7d4f-4851-9f65-01cb4ee95304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:40.499580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc68b-7d4f-4851-9f65-01cb4ee95304 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.499942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc68b-7d4f-4851-9f65-01cb4ee95304 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.500215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc68b-7d4f-4851-9f65-01cb4ee95304 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.501325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cc68b-7d4f-4851-9f65-01cb4ee95304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:40.502816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cc68b-7d4f-4851-9f65-01cb4ee95304 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:40.504518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 86/168] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:40.505523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870c95-8eaf-457a-bf3e-d66822232d58 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.505816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870c95-8eaf-457a-bf3e-d66822232d58 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.506110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70870c95-8eaf-457a-bf3e-d66822232d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.527014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-70870c95-8eaf-457a-bf3e-d66822232d58 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:40.528186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-70870c95-8eaf-457a-bf3e-d66822232d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:40.591602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4643-5ff7-4911-b5c9-b304d1a2195f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:40.598503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 87/169] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:40.599492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870c95-8eaf-457a-bf3e-d66822232d58 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.630251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:40.652212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:40.652821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.653324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.653453 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.654044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:40.654354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:40.656058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:40.664389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 83/170] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:40.665096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.715980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:40.720464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70870c95-8eaf-457a-bf3e-d66822232d58 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:40.758120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:40.758675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.758956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.759230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.759882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:40.761314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:40.772175 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d031-54cf-447e-9d3e-acfb348eec40 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:40.783085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 88/171] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:52:40 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:40.787640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.820792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:40.822780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.823340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.824112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.843391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:40.851909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:40.852891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:40.853674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:40.858172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 84/172] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:40.864059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.912091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:40.916915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5fade-7848-47aa-b400-486594bf8197 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:40.953698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:40.954365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:40.955232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:40.955232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] PATH_INFO: `/v3/users/b1bd4478038b48b699f781a4571169b0` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:40.972219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] RBAC: Authorizing `identity:get_user(user_id=b1bd4478038b48b699f781a4571169b0)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:40.973688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:40.975559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 89/173] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:40 2022] GET /identity/v3/users/b1bd4478038b48b699f781a4571169b0 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:40.976150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:40.989101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a1d4b-2155-49bc-8a29-9ce8bd282fc3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:40.993451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:41.037111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.037766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.037933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.038234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.038952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:41.039205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:41.040591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:41.050142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 85/174] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:41.051311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.097141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137880-ea1a-4808-b2d9-bcc0241bf904 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.138787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.140583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.142321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.142813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.155030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:41.160033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:41.160942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:41.161744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 90/175] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:52:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:41.162472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.176908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:41.180767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51650f-d417-42e5-951a-3290e7514410 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.223064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.223700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.223985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.224262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.225406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:41.226934 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:41.228655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 86/176] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:41 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:41.229518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.286831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141c76d-aa24-469a-a985-d7de672fa08e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.302502 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:41.329287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.330353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.330641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.330923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] PATH_INFO: `/v3/users/7a4e61679c8a4b3f9797d85430a3b95b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.332098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] RBAC: Authorizing `identity:get_user(user_id=7a4e61679c8a4b3f9797d85430a3b95b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:41.334391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:41.336277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 91/177] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:41 2022] GET /identity/v3/users/7a4e61679c8a4b3f9797d85430a3b95b => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:41.338912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.351216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6001662-f6e7-48cf-9491-290f2bca8e6a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.387839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.388512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.388794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.389781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.390851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:41.391133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:41.392522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:41.401877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 87/178] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:52:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:41.402665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.435725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:41.464635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f53cd-428d-42b9-bbe3-4364fdf60d21 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.506384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.507438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.508130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.508691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/b1bd4478038b48b699f781a4571169b0/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.510857 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d7744e0548a433db28d5f5222cd16a9, user_id=b1bd4478038b48b699f781a4571169b0, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:41.511399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8e8f0-23f1-4f23-87df-2f3c49862246 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.512893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:41.528359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 92/179] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:41 2022] PUT /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/b1bd4478038b48b699f781a4571169b0/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:41.529643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.533017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:41.582186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.582824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.583110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.583386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.663093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b12101-f051-4afd-a6b8-e67095785777 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.705603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.706706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.707210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.707686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] PATH_INFO: `/v3/users/7a4e61679c8a4b3f9797d85430a3b95b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.709156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] RBAC: Authorizing `identity:get_user(user_id=7a4e61679c8a4b3f9797d85430a3b95b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:41.710880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:41.712829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 93/180] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:41 2022] GET /identity/v3/users/7a4e61679c8a4b3f9797d85430a3b95b => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:41.720259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.721426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:41.724858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:41.777329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:41.843954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 88/181] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:52:41.849913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:41.879104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:41.923976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b8a00-1a6d-40c5-b6e9-1d624537b940 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.964447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:41.964672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba5d7-ac4c-4aed-b6a8-9a6f8fd4d66d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:41.965973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:41.966504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:41.967585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:41.996756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:42.017465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:42.018129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:42.018411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:42.018680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:42.020321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:42.021745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:42.023399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 89/182] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:41 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:42.033285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:42.066551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:42.068020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:42.177949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:42.205716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252000-3d54-4ee7-a0c2-fc99a5b14885 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:42.243125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 94/183] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 19:52:42.250195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:42.250822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:42.251099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:42.251364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:42.252103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=1d7744e0548a433db28d5f5222cd16a9, user.id=7a4e61679c8a4b3f9797d85430a3b95b) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:42.252409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:42.253840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:42.259913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:42.260707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 90/184] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:42 2022] GET /identity/v3/role_assignments?user.id=7a4e61679c8a4b3f9797d85430a3b95b&scope.project.id=1d7744e0548a433db28d5f5222cd16a9&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:42.413867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ae18-d826-420a-b245-c1c59c0fc8a1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:42.463754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1346b9-b9cc-4ea1-81f5-836e7aec3d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:42.464311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1346b9-b9cc-4ea1-81f5-836e7aec3d2d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:42.464592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1346b9-b9cc-4ea1-81f5-836e7aec3d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:42.464870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1346b9-b9cc-4ea1-81f5-836e7aec3d2d None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:42.466016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1346b9-b9cc-4ea1-81f5-836e7aec3d2d None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:42.468111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1346b9-b9cc-4ea1-81f5-836e7aec3d2d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:42.470132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 95/185] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:42 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:42.475769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:42.586355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:42.640997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4585f5-ffd4-4656-bd6c-7efcc6d3d6ad None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:42.680030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27505-a4ca-44bd-84b3-fb7829a406fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:42.680634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27505-a4ca-44bd-84b3-fb7829a406fa None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:42.680916 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27505-a4ca-44bd-84b3-fb7829a406fa None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:42.681190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27505-a4ca-44bd-84b3-fb7829a406fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:42.681925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27505-a4ca-44bd-84b3-fb7829a406fa None admin] RBAC: Adding query filter params (role.id=658c99e6ef4841b5844a33d88f1b2d68, scope.project.id=1d7744e0548a433db28d5f5222cd16a9, user.id=7a4e61679c8a4b3f9797d85430a3b95b) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:42.682263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27505-a4ca-44bd-84b3-fb7829a406fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:42.683696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27505-a4ca-44bd-84b3-fb7829a406fa None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:42.690880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 91/186] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:42 2022] GET /identity/v3/role_assignments?user.id=7a4e61679c8a4b3f9797d85430a3b95b&scope.project.id=1d7744e0548a433db28d5f5222cd16a9&role.id=658c99e6ef4841b5844a33d88f1b2d68 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:43.213707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af27e9-49da-4441-9943-cb7cd9585b69 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:43.214243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af27e9-49da-4441-9943-cb7cd9585b69 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:43.214315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af27e9-49da-4441-9943-cb7cd9585b69 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:43.215675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 96/187] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:43.221035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750f78-a569-45b3-898c-67e53c4f7a1c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:43.221436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750f78-a569-45b3-898c-67e53c4f7a1c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:43.221598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750f78-a569-45b3-898c-67e53c4f7a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:43.240389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-00750f78-a569-45b3-898c-67e53c4f7a1c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:43.241596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-00750f78-a569-45b3-898c-67e53c4f7a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:43.307970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 92/188] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:43.509337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36eeed-1334-4697-98a4-59c008348c8d None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:43.509572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36eeed-1334-4697-98a4-59c008348c8d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:43.509960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36eeed-1334-4697-98a4-59c008348c8d None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:43.511410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 97/189] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:43.517374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed270d31-e785-460d-ad66-482568018acc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:43.517669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed270d31-e785-460d-ad66-482568018acc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:43.517949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed270d31-e785-460d-ad66-482568018acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:43.535859 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ed270d31-e785-460d-ad66-482568018acc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:43.537031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ed270d31-e785-460d-ad66-482568018acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:43.580882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36eeed-1334-4697-98a4-59c008348c8d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:43.587374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:43.607979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 93/190] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:43.630756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:43.696226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36eeed-1334-4697-98a4-59c008348c8d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:43.731348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:43.731976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:43.732255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:43.732526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:43.743913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:43.749464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:43.750560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:43.751361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 98/191] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:43.756430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed270d31-e785-460d-ad66-482568018acc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:43.856047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed270d31-e785-460d-ad66-482568018acc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:43.877941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:43.893088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:43.893954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:43.894494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:43.894775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:43.895446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:43.895751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:43.897371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:43.908038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 94/192] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:43.913370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:43.964839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:43.990387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:43.994636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67056c67-0a5b-44d8-a64e-ac8efd679b90 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:44.027802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a60fd-b69d-4c63-948e-df02df89c9fe None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:44.031331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:44.031965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.032246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.032512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.033629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:44.035096 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:44.038477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 99/193] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:44.041931 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:44.066250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:44.067183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.067639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.068494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] PATH_INFO: `/v3/users/b06c8be59bee4c31927aae101f5d98b7` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.082750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=b06c8be59bee4c31927aae101f5d98b7)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:44.084475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:44.086341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 95/194] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:43 2022] GET /identity/v3/users/b06c8be59bee4c31927aae101f5d98b7 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:44.091668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:44.153642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536ca9-72f0-40b3-a2dc-c1b987f768f0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:44.187950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefac7f-550e-448b-8294-7d79e6af6f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:44.188554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefac7f-550e-448b-8294-7d79e6af6f87 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.188832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefac7f-550e-448b-8294-7d79e6af6f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.189104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefac7f-550e-448b-8294-7d79e6af6f87 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.189753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefac7f-550e-448b-8294-7d79e6af6f87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:44.191220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefac7f-550e-448b-8294-7d79e6af6f87 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:44.191340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998716f3-3375-4788-85bb-a2c17e1f8ab9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:44.198417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:44.212467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 100/195] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:52:44 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:52:44.213653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebad16-ad49-4537-a268-00e065448e06 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.213945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebad16-ad49-4537-a268-00e065448e06 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.214574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebad16-ad49-4537-a268-00e065448e06 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.215623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 101/196] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:44.221951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467bb45-4405-4a94-8f2b-2c276e085e59 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.222276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467bb45-4405-4a94-8f2b-2c276e085e59 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.222557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467bb45-4405-4a94-8f2b-2c276e085e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.229538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:44.230225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.230503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.230776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.232032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:44.233885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:44.236067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 96/197] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:44 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:44.242295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:44.245088 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9467bb45-4405-4a94-8f2b-2c276e085e59 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:44.246467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9467bb45-4405-4a94-8f2b-2c276e085e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:44.266739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:44.328449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 102/198] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:44.354419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588b1d1-50e1-4a96-a367-6aa44f37213a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:44.393356 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:44.394027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.394334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.394636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/b06c8be59bee4c31927aae101f5d98b7/roles/481205a2142b44eab56a5217d0724061` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.396524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d7744e0548a433db28d5f5222cd16a9, user_id=b06c8be59bee4c31927aae101f5d98b7, role_id=481205a2142b44eab56a5217d0724061)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:44.397956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:44.413374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 97/199] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:52:44 2022] PUT /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9/users/b06c8be59bee4c31927aae101f5d98b7/roles/481205a2142b44eab56a5217d0724061 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:52:44.604471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467bb45-4405-4a94-8f2b-2c276e085e59 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:44.712614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467bb45-4405-4a94-8f2b-2c276e085e59 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:44.750962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:44.752022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.752545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.753032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.764662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:44.769888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:44.770795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:44.771583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:44.774221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 103/200] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:44.782624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:44.815875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:44.886839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74f936-ddda-4f70-9f40-9e7b5cb4c456 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:44.929187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:44.930293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:44.930775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:44.931270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:44.932137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:44.932685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:44.934269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:44.943875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 98/201] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:44.951368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:44.970603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:45.062265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d6c42-4c47-4e76-8e59-7f72fddd3e45 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:45.098737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:45.099379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:45.099651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:45.099929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] PATH_INFO: `/v3/users/b1bd4478038b48b699f781a4571169b0` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:45.101085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] RBAC: Authorizing `identity:get_user(user_id=b1bd4478038b48b699f781a4571169b0)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:45.102579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:45.104476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 104/202] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:44 2022] GET /identity/v3/users/b1bd4478038b48b699f781a4571169b0 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:45.111370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:45.211685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:45.218310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cec4e-3a01-4dc4-9e52-f33401eb93a6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:45.254254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:45.254869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:45.255099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:45.255328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:45.327841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:45.329346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:45.430940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:45.438443 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 99/203] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:52:45.447312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:45.534531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:45.552895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53bc11-a24c-4fe2-b8dd-83b3ca2e3177 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:45.589961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a9cc9-bdfd-47c4-9464-10700c1d1d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:45.590683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9cc9-bdfd-47c4-9464-10700c1d1d9c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:45.590962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9cc9-bdfd-47c4-9464-10700c1d1d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:45.591236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a9cc9-bdfd-47c4-9464-10700c1d1d9c None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:45.593059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a9cc9-bdfd-47c4-9464-10700c1d1d9c None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:45.594531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a9cc9-bdfd-47c4-9464-10700c1d1d9c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:45.596242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 105/204] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:45 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:45.605189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:45.721806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e148c3-f931-43df-84f1-01a6e522e856 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:45.759317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f488cc0-99bb-470d-8070-27793af9ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:45.760256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f488cc0-99bb-470d-8070-27793af9ca0b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:45.760715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f488cc0-99bb-470d-8070-27793af9ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:45.761166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f488cc0-99bb-470d-8070-27793af9ca0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:45.762071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f488cc0-99bb-470d-8070-27793af9ca0b None admin] RBAC: Adding query filter params (role.id=a1d711c0f4c7442ebc3831a3489bcd58, scope.project.id=1d7744e0548a433db28d5f5222cd16a9, user.id=b1bd4478038b48b699f781a4571169b0) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:45.762587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f488cc0-99bb-470d-8070-27793af9ca0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:45.764928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f488cc0-99bb-470d-8070-27793af9ca0b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:45.775374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 100/205] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:45 2022] GET /identity/v3/role_assignments?user.id=b1bd4478038b48b699f781a4571169b0&scope.project.id=1d7744e0548a433db28d5f5222cd16a9&role.id=a1d711c0f4c7442ebc3831a3489bcd58 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:46.627600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682f89b-a866-4c37-bab0-0895508d1424 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:46.628099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682f89b-a866-4c37-bab0-0895508d1424 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:46.628210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682f89b-a866-4c37-bab0-0895508d1424 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:46.629535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 106/206] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:46.634927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3860-0c84-4470-a61f-26f4442a6bd8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:46.635334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3860-0c84-4470-a61f-26f4442a6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:46.635497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3860-0c84-4470-a61f-26f4442a6bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:46.638545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab262c7-e511-486e-91f6-75f14eafaaa6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:46.639043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab262c7-e511-486e-91f6-75f14eafaaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:46.639908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab262c7-e511-486e-91f6-75f14eafaaa6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:46.641324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 107/207] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:52:46.646988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733102-44fb-4ba6-bc1a-4207768bd87e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:46.647273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733102-44fb-4ba6-bc1a-4207768bd87e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:46.647546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81733102-44fb-4ba6-bc1a-4207768bd87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:46.655523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-50fe3860-0c84-4470-a61f-26f4442a6bd8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:46.656748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-50fe3860-0c84-4470-a61f-26f4442a6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:46.665423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-81733102-44fb-4ba6-bc1a-4207768bd87e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:46.666621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-81733102-44fb-4ba6-bc1a-4207768bd87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:46.713968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:46.725539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 101/208] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:46.726784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513ba0-ac7c-4e48-9b5d-65e35a470707 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:46.727066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513ba0-ac7c-4e48-9b5d-65e35a470707 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:46.727337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513ba0-ac7c-4e48-9b5d-65e35a470707 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:46.733414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 102/209] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:46.734501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb35ac-47ac-47b8-aa1a-596ce7d7e63b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:46.734922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 108/210] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:46.738247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb35ac-47ac-47b8-aa1a-596ce7d7e63b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:46.738633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb35ac-47ac-47b8-aa1a-596ce7d7e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:46.762132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-35bb35ac-47ac-47b8-aa1a-596ce7d7e63b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:46.763305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-35bb35ac-47ac-47b8-aa1a-596ce7d7e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:46.830905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 103/211] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:46.991435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81733102-44fb-4ba6-bc1a-4207768bd87e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.003733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb35ac-47ac-47b8-aa1a-596ce7d7e63b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.079417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:47.107870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81733102-44fb-4ba6-bc1a-4207768bd87e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.111820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb35ac-47ac-47b8-aa1a-596ce7d7e63b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.133299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:47.143490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.144114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.144389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.144655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.148007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.148612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.148895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.149168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.150295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.151727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:47.153308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 104/212] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:47.153308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.159332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:47.164184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:47.165232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:47.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 109/213] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:47.167338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.255584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91b4a-aa71-48b1-ad4d-2ae67e336d37 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.266367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efe170-b11e-4bc9-944d-34924103ae5d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.289248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.289952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.290268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.290552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.299179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.299780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.300061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.300340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.300983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.301107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:47.302447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:47.306011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:47.307056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:47.308009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 105/214] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:47.309552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.313201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:47.325413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 110/215] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:52:47 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:47.326863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.378602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:47.439793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193ec40-1e25-449e-8a6c-74579fae3e09 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.440266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc53f3-6bbd-476e-b316-2a177d3a9905 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.477309 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.477655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.477927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.478254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.478367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.478520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.478611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.478813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.479199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:47.479488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:47.479591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.479796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.480875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:47.481161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:47.495774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 111/216] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:47.495961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 106/217] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:47.497500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.497651 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.568709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:47.622784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eda0a4-ad55-4e17-88a2-a37470468f9b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.632695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fae86-ed5d-4de9-8118-2d9716948240 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.637800 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:47.672522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.673157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.673440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.673926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] PATH_INFO: `/v3/users/6fca08213bc14fa8824de4540faf8fd7` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.679522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.680157 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.680437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.680707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] PATH_INFO: `/v3/users/b06c8be59bee4c31927aae101f5d98b7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.681847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] RBAC: Authorizing `identity:get_user(user_id=b06c8be59bee4c31927aae101f5d98b7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.683328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:47.684929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 112/218] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/users/b06c8be59bee4c31927aae101f5d98b7 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:47.692284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] RBAC: Authorizing `identity:get_user(user_id=6fca08213bc14fa8824de4540faf8fd7)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.693741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:47.693846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.695615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 107/219] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/users/6fca08213bc14fa8824de4540faf8fd7 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:47.700939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:47.816032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60151345-8cf6-422a-8074-385367e4ba40 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.841674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:47.842425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddad6-5c95-49f7-b93a-f1939e7cb177 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:47.860295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.861173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.861493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.861769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.881266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:47.881924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:47.882260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:47.882532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:47.883262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] RBAC: Adding query filter params (role.id=a1d711c0f4c7442ebc3831a3489bcd58, user.id=6fca08213bc14fa8824de4540faf8fd7, scope.system=all) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:47.883567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.884989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:47.891532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 108/220] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/role_assignments?user.id=6fca08213bc14fa8824de4540faf8fd7&scope.system=all&role.id=a1d711c0f4c7442ebc3831a3489bcd58 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:47.951411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:47.953785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:48.073395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 113/221] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:52:48.079701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:48.114251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:48.188323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa75e04-72ce-4b69-af70-7d4eb47aac38 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:48.225573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1c572-685d-46b9-858c-b0ffe89610a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:48.226515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1c572-685d-46b9-858c-b0ffe89610a9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:48.226966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1c572-685d-46b9-858c-b0ffe89610a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:48.227433 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1c572-685d-46b9-858c-b0ffe89610a9 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:48.228715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1c572-685d-46b9-858c-b0ffe89610a9 None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:48.230355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1c572-685d-46b9-858c-b0ffe89610a9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:48.232175 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 109/222] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:52:48 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:48.239820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:48.267638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:48.349865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13169bba-828f-4250-a372-a2e529e25425 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:48.394136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbdabf-1a32-4188-a993-a08e611de5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:48.395023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbdabf-1a32-4188-a993-a08e611de5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:48.395470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbdabf-1a32-4188-a993-a08e611de5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:48.395937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbdabf-1a32-4188-a993-a08e611de5d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:48.396828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbdabf-1a32-4188-a993-a08e611de5d6 None admin] RBAC: Adding query filter params (role.id=481205a2142b44eab56a5217d0724061, scope.project.id=1d7744e0548a433db28d5f5222cd16a9, user.id=b06c8be59bee4c31927aae101f5d98b7) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:48.397300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbdabf-1a32-4188-a993-a08e611de5d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:48.398948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbdabf-1a32-4188-a993-a08e611de5d6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:48.406045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 114/223] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:52:48 2022] GET /identity/v3/role_assignments?user.id=b06c8be59bee4c31927aae101f5d98b7&scope.project.id=1d7744e0548a433db28d5f5222cd16a9&role.id=481205a2142b44eab56a5217d0724061 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:49.644049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a556-c83a-4495-8328-5fba14b14ed3 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:49.644555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a556-c83a-4495-8328-5fba14b14ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:49.644628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a556-c83a-4495-8328-5fba14b14ed3 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:49.645973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 110/224] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:49.651254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589202fb-a571-40ea-a4e3-991554eba50c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:49.651664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589202fb-a571-40ea-a4e3-991554eba50c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:49.651802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589202fb-a571-40ea-a4e3-991554eba50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:49.670203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-589202fb-a571-40ea-a4e3-991554eba50c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:49.671482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-589202fb-a571-40ea-a4e3-991554eba50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:49.720313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122999a-45b0-4209-9169-c0fca96ec7e3 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:49.720597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122999a-45b0-4209-9169-c0fca96ec7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:49.720876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122999a-45b0-4209-9169-c0fca96ec7e3 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:49.722230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 111/225] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:52:49.727722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33161a1-c4b3-4fd9-8b69-fa912838cc36 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:49.728030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33161a1-c4b3-4fd9-8b69-fa912838cc36 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:49.728306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33161a1-c4b3-4fd9-8b69-fa912838cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:49.747530 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 115/226] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:49.748757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e33161a1-c4b3-4fd9-8b69-fa912838cc36 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:49.750031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e33161a1-c4b3-4fd9-8b69-fa912838cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:49.817122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 112/227] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:50.017334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589202fb-a571-40ea-a4e3-991554eba50c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.038284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:50.087360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33161a1-c4b3-4fd9-8b69-fa912838cc36 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.116923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:50.122357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589202fb-a571-40ea-a4e3-991554eba50c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.156807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee0c86-0f34-4e8e-b007-74da97a4d159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.157443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee0c86-0f34-4e8e-b007-74da97a4d159 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.157715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee0c86-0f34-4e8e-b007-74da97a4d159 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.157986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee0c86-0f34-4e8e-b007-74da97a4d159 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.167735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee0c86-0f34-4e8e-b007-74da97a4d159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b4ee0c86-0f34-4e8e-b007-74da97a4d159 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:50.172708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:50.173562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:50.174406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 116/228] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:50.175153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71ea77-7f2d-4b68-8522-82442874b924 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.175217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71ea77-7f2d-4b68-8522-82442874b924 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.175495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71ea77-7f2d-4b68-8522-82442874b924 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.177193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 117/229] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:50.179810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71ea77-7f2d-4b68-8522-82442874b924 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.193193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33161a1-c4b3-4fd9-8b69-fa912838cc36 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.227530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411a697-7489-45fe-8da9-244efeaa173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.228151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411a697-7489-45fe-8da9-244efeaa173f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.228435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411a697-7489-45fe-8da9-244efeaa173f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.228711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411a697-7489-45fe-8da9-244efeaa173f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.229816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411a697-7489-45fe-8da9-244efeaa173f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:50.231299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411a697-7489-45fe-8da9-244efeaa173f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:50.233186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 113/230] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:50.234419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c58f7-81d6-4634-9ac7-884633106f0e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.234774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c58f7-81d6-4634-9ac7-884633106f0e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.234978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c58f7-81d6-4634-9ac7-884633106f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.253738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9e5c58f7-81d6-4634-9ac7-884633106f0e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:50.254960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9e5c58f7-81d6-4634-9ac7-884633106f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:50.261646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:50.284519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71ea77-7f2d-4b68-8522-82442874b924 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.318190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.318789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.319066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.319335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.319992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:50.320291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:50.320509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 114/231] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:50.321664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:50.322924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c58f7-81d6-4634-9ac7-884633106f0e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.334512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 118/232] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:50.336295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.354718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:50.435488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c58f7-81d6-4634-9ac7-884633106f0e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.443140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62011777-b28c-41af-b8df-4a4f2c0c4617 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.474867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.475570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.475926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.476208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] PATH_INFO: `/v3/groups` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.476842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:50.477629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.478278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.478373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:50.478559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.478830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] PATH_INFO: `/v3/users/3f30d90d98d34e9f98397d096a80348f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.490987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:50.494365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] RBAC: Authorizing `identity:get_user(user_id=3f30d90d98d34e9f98397d096a80348f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:50.506315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 115/233] 10.222.0.18 () {60 vars in 1134 bytes} [Sun Oct 23 19:52:50 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:52:50.506513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:50.506513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 119/234] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/users/3f30d90d98d34e9f98397d096a80348f => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:50.506707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.589789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.614813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:50.631781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68365df-b33e-40cf-a7c2-ecffc5866253 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.675370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.676855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.676855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.677017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.678591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] RBAC: Adding query filter params (role.id=481205a2142b44eab56a5217d0724061, user.id=3f30d90d98d34e9f98397d096a80348f, scope.system=all) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:50.678591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:50.679991 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:50.687870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 116/235] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/role_assignments?user.id=3f30d90d98d34e9f98397d096a80348f&scope.system=all&role.id=481205a2142b44eab56a5217d0724061 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:50.702419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860c65-4e0b-4d63-9abf-f8cd72f31178 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.745541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.746631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.747112 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.747603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.760826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:50.766753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:50.767786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:50.768571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 120/236] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:50.775402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:50.887003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170c3b-7533-4940-82bb-f0567b5fed2f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:50.922401 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:50.923013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:50.923291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:50.923560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:50.924226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:50.924527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:50.925897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:50.934148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 117/237] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:50.940565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:51.003660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:51.048084 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffb2fa-c44c-43af-ae96-93662a97e0f3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:51.083098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1e5a-48f1-43d6-96cc-b96f5bcfae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:51.083728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1e5a-48f1-43d6-96cc-b96f5bcfae34 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:51.084002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1e5a-48f1-43d6-96cc-b96f5bcfae34 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:51.084276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1e5a-48f1-43d6-96cc-b96f5bcfae34 None admin] PATH_INFO: `/v3/users/6fca08213bc14fa8824de4540faf8fd7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:51.085438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1e5a-48f1-43d6-96cc-b96f5bcfae34 None admin] RBAC: Authorizing `identity:get_user(user_id=6fca08213bc14fa8824de4540faf8fd7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:51.086958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1e5a-48f1-43d6-96cc-b96f5bcfae34 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:51.088723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 121/238] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:50 2022] GET /identity/v3/users/6fca08213bc14fa8824de4540faf8fd7 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:51.094898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:51.113184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:51.201241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404538c-a15f-4dea-85c9-d2b03bb43971 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:51.234569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c8338-3f53-446a-bff5-b66adf4ad59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:51.235219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c8338-3f53-446a-bff5-b66adf4ad59d None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:51.235565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c8338-3f53-446a-bff5-b66adf4ad59d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:51.235780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c8338-3f53-446a-bff5-b66adf4ad59d None admin] PATH_INFO: `/v3/system/users/6fca08213bc14fa8824de4540faf8fd7/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:51.237262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c8338-3f53-446a-bff5-b66adf4ad59d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6fca08213bc14fa8824de4540faf8fd7, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:51.238804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c8338-3f53-446a-bff5-b66adf4ad59d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:51.247958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 118/239] 10.222.0.18 () {58 vars in 1334 bytes} [Sun Oct 23 19:52:51 2022] PUT /identity/v3/system/users/6fca08213bc14fa8824de4540faf8fd7/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:52.714956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ce81c-c452-48d9-a20f-54d021bbd54f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:52.715461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ce81c-c452-48d9-a20f-54d021bbd54f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:52.715567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ce81c-c452-48d9-a20f-54d021bbd54f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:52.716940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 122/240] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:52.722416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c801-c71f-4d85-beee-185d8a5a8434 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:52.722923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c801-c71f-4d85-beee-185d8a5a8434 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:52.722994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c801-c71f-4d85-beee-185d8a5a8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:52.743225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-66e9c801-c71f-4d85-beee-185d8a5a8434 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:52.744432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-66e9c801-c71f-4d85-beee-185d8a5a8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:52.813017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:52.847354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db2a79-1779-4ccb-a7e8-75ee5517dc56 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:52.847671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db2a79-1779-4ccb-a7e8-75ee5517dc56 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:52.847915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db2a79-1779-4ccb-a7e8-75ee5517dc56 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:52.849385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 123/242] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:52.854366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689909-fdb5-45bd-bc4d-169f5cffb8c8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:52.854601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689909-fdb5-45bd-bc4d-169f5cffb8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:52.854874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689909-fdb5-45bd-bc4d-169f5cffb8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:52.873481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2f689909-fdb5-45bd-bc4d-169f5cffb8c8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:52.874704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2f689909-fdb5-45bd-bc4d-169f5cffb8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:52.876707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:52.946371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 120/243] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:52:53.086182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db2a79-1779-4ccb-a7e8-75ee5517dc56 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:53.189060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db2a79-1779-4ccb-a7e8-75ee5517dc56 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:53.213408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689909-fdb5-45bd-bc4d-169f5cffb8c8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:53.215091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:53.225147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:53.225769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.226044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.226341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.227431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:53.228865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:53.230622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 124/244] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:52:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:53.236014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:53.321678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689909-fdb5-45bd-bc4d-169f5cffb8c8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:53.347678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8df13-fbd7-41ca-ae70-96aead537f1b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:53.360088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:53.360949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.361408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.361881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.368924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:53.374215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:53.379268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:53.380307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:53.381079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:53.383009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 121/245] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:52:53.386247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d471b-6261-478e-9532-ca68be43cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:53.386247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d471b-6261-478e-9532-ca68be43cbb2 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.386247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d471b-6261-478e-9532-ca68be43cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.386247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d471b-6261-478e-9532-ca68be43cbb2 None admin] PATH_INFO: `/v3/groups` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.386500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d471b-6261-478e-9532-ca68be43cbb2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:53.387320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d471b-6261-478e-9532-ca68be43cbb2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:53.388543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:53.413747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 125/246] 10.222.0.18 () {60 vars in 1134 bytes} [Sun Oct 23 19:52:53 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:52:53.413747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0222-0100-43ec-88fc-055e8d02c9b4 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.413747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0222-0100-43ec-88fc-055e8d02c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.413747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0222-0100-43ec-88fc-055e8d02c9b4 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.413747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 126/247] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:53.415479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d221e95-b167-4b5b-ac16-78b48f41fc09 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.415766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d221e95-b167-4b5b-ac16-78b48f41fc09 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.416043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d221e95-b167-4b5b-ac16-78b48f41fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.439353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7d221e95-b167-4b5b-ac16-78b48f41fc09 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:53.440513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7d221e95-b167-4b5b-ac16-78b48f41fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:53.499586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:53.509964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13735-c190-4d80-8b8d-76d9e5e91fc0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:53.524181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 127/248] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:53.551577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:53.552646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.553117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.553640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.554594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:53.555130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:53.556748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:53.568031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 122/249] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:53.573482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d221e95-b167-4b5b-ac16-78b48f41fc09 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:53.686928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d221e95-b167-4b5b-ac16-78b48f41fc09 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:53.731170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:53.732477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.733293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.733571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] PATH_INFO: `/v3/users/3f30d90d98d34e9f98397d096a80348f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.734753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] RBAC: Authorizing `identity:get_user(user_id=3f30d90d98d34e9f98397d096a80348f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:53.736364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:53.738184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 128/250] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:53 2022] GET /identity/v3/users/3f30d90d98d34e9f98397d096a80348f => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:53.743647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:53.799761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:53.817483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:53.870573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24fcf-2aee-457f-b3f7-a455504a22d1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:53.884922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:53.913061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:53.913707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.913986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.914289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] PATH_INFO: `/v3/system/users/3f30d90d98d34e9f98397d096a80348f/roles/481205a2142b44eab56a5217d0724061` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:53.916255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f30d90d98d34e9f98397d096a80348f, role_id=481205a2142b44eab56a5217d0724061)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:53.917634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:53.927475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 123/251] 10.222.0.18 () {58 vars in 1334 bytes} [Sun Oct 23 19:52:53 2022] PUT /identity/v3/system/users/3f30d90d98d34e9f98397d096a80348f/roles/481205a2142b44eab56a5217d0724061 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:53.947259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c09e6-c365-451c-84cb-22622811fd38 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:53.990764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:53.991388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:53.991670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:53.991946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:54.005235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:54.013259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:54.016339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:54.017148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 129/252] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:54.021092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:54.137196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7c3b3-2f2a-4dba-b6e2-3ac45e967a68 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:54.163077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:54.175982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:54.177065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:54.177755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:54.178111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:54.178784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:54.179091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:54.180454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:54.190247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 124/253] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:54.196062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:54.311318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da272-c499-48ee-9422-55cd4ab7763e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:54.325639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:54.363631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d52a0-287e-4189-8f77-cbf87b3aa59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:54.364269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d52a0-287e-4189-8f77-cbf87b3aa59a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:54.364550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d52a0-287e-4189-8f77-cbf87b3aa59a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:54.364821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d52a0-287e-4189-8f77-cbf87b3aa59a None admin] PATH_INFO: `/v3/users/6fca08213bc14fa8824de4540faf8fd7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:54.365987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d52a0-287e-4189-8f77-cbf87b3aa59a None admin] RBAC: Authorizing `identity:get_user(user_id=6fca08213bc14fa8824de4540faf8fd7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:54.367471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d52a0-287e-4189-8f77-cbf87b3aa59a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:54.369388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 130/254] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:54 2022] GET /identity/v3/users/6fca08213bc14fa8824de4540faf8fd7 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:54.375159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:54.545851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f8778-4144-4793-accf-a76a4ca799cd None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:54.597687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959be6b-71cb-4cd2-966a-c4e10cf4629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:54.598692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959be6b-71cb-4cd2-966a-c4e10cf4629e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:54.599171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959be6b-71cb-4cd2-966a-c4e10cf4629e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:54.599637 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959be6b-71cb-4cd2-966a-c4e10cf4629e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:54.600577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959be6b-71cb-4cd2-966a-c4e10cf4629e None admin] RBAC: Adding query filter params (role.id=a1d711c0f4c7442ebc3831a3489bcd58, user.id=6fca08213bc14fa8824de4540faf8fd7, scope.system=all) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:54.601109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959be6b-71cb-4cd2-966a-c4e10cf4629e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:54.602811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959be6b-71cb-4cd2-966a-c4e10cf4629e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:54.621393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 125/255] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Oct 23 19:52:54 2022] GET /identity/v3/role_assignments?user.id=6fca08213bc14fa8824de4540faf8fd7&scope.system=all&role.id=a1d711c0f4c7442ebc3831a3489bcd58 => generated 510 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:56.515271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18181b4-caf8-41c9-8dcd-54333d1220aa None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:56.515793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18181b4-caf8-41c9-8dcd-54333d1220aa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:56.515793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18181b4-caf8-41c9-8dcd-54333d1220aa None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:56.517357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 131/256] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:56.523495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cb633-02cc-40b3-b76b-061597b7f2dc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:56.524004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cb633-02cc-40b3-b76b-061597b7f2dc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:56.524110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cb633-02cc-40b3-b76b-061597b7f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:56.549385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-567cb633-02cc-40b3-b76b-061597b7f2dc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:56.550625 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-567cb633-02cc-40b3-b76b-061597b7f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:56.604484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:56.624402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 126/257] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 19:52:56.652841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8eef-0a46-4205-980a-5bac997ebba8 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:56.653460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8eef-0a46-4205-980a-5bac997ebba8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:56.653935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8eef-0a46-4205-980a-5bac997ebba8 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:56.655866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 132/258] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:56.665560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628feced-6774-4824-a350-fbeb59ccffb6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:56.665860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628feced-6774-4824-a350-fbeb59ccffb6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:56.666149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628feced-6774-4824-a350-fbeb59ccffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:56.688038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-628feced-6774-4824-a350-fbeb59ccffb6 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:56.690466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398707-4209-4f8f-bf31-12602a1ce3c6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:56.690963 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398707-4209-4f8f-bf31-12602a1ce3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:56.691458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398707-4209-4f8f-bf31-12602a1ce3c6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:56.692995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 133/259] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:56.693727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-628feced-6774-4824-a350-fbeb59ccffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:56.699158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ace708-98ad-4645-b7f7-b903865fc231 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:56.699784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ace708-98ad-4645-b7f7-b903865fc231 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:56.700432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ace708-98ad-4645-b7f7-b903865fc231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:56.708296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 127/260] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 19:52:56.731068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-02ace708-98ad-4645-b7f7-b903865fc231 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:56.732295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-02ace708-98ad-4645-b7f7-b903865fc231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:56.740418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 134/261] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 23 19:52:57.079359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628feced-6774-4824-a350-fbeb59ccffb6 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.091045 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628feced-6774-4824-a350-fbeb59ccffb6 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.095897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd3b35-0628-4fb8-8dd0-d2e54bfe93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.096530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd3b35-0628-4fb8-8dd0-d2e54bfe93ab admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.096811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd3b35-0628-4fb8-8dd0-d2e54bfe93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.097086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd3b35-0628-4fb8-8dd0-d2e54bfe93ab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.113558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd3b35-0628-4fb8-8dd0-d2e54bfe93ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:57.118577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6f46-2966-4b05-a381-12bec27ff569 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.118862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6f46-2966-4b05-a381-12bec27ff569 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.119135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6f46-2966-4b05-a381-12bec27ff569 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.120488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 135/262] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d3cd3b35-0628-4fb8-8dd0-d2e54bfe93ab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:57.121978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:57.122861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:57.123853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 128/263] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:57.129433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad6f46-2966-4b05-a381-12bec27ff569 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.137711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a09ce-40dc-46c1-94b1-32e518fdb764 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.137999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a09ce-40dc-46c1-94b1-32e518fdb764 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.138309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a09ce-40dc-46c1-94b1-32e518fdb764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.148425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad6f46-2966-4b05-a381-12bec27ff569 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.159952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.160552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.160831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.161101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.161768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:57.162072 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.163930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 19:52:57.163930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 19:52:57.163930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 19:52:57.164861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.179717 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0d8a09ce-40dc-46c1-94b1-32e518fdb764 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:57.180906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0d8a09ce-40dc-46c1-94b1-32e518fdb764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:57.187362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 136/264] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.188201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.210971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5b241-4515-4882-88fc-ec00d542063b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.219125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.219751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.220032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.220308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.236999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:57.245194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:57.246690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 137/265] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:57.249120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.260980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b577ada-c422-460e-b696-3672d2ab6402 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.266552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.267615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.267615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.267975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.274701 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.276231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 19:52:57.276231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 19:52:57.276231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 19:52:57.277186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.279067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 138/266] 10.222.0.18 () {56 vars in 1201 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.279829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.294336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 129/267] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:52:57.294516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b04ac1-d8ec-4783-9b57-fd5d40c33b57 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.296821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a09ce-40dc-46c1-94b1-32e518fdb764 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.299849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.300539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.300892 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.301239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.307610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a09ce-40dc-46c1-94b1-32e518fdb764 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.313141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.313957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.314417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.314875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.315215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:57.315891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:57.316359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.318312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 19:52:57.318312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 19:52:57.318312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 19:52:57.319528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:57.320531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:57.321438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:57.322252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 139/268] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:57.322895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.334618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620cd7-43a2-4a04-ac0b-4651a61203aa admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.335060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 130/269] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.336156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.341152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.342354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.342729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.343079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.345087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.347567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.348684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8993-02a0-4dc2-8648-d50747dd283a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.349355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 140/270] 10.222.0.18 () {56 vars in 1207 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.350199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.353884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.354895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.355440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.355953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.356808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:57.357879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.359892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.368341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff862-9658-4133-a3ae-94f3adc100ce admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.372027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 131/271] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.372948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.375380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.376245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.376666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.377137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.378576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.381123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.383681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 141/272] 10.222.0.18 () {56 vars in 1201 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.385851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.390493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4f89-53bb-45e0-9918-40dafbc2f236 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.395993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.396830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.397327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.397738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f/groups/630f36be79ec406cb7dc9a08070d245a/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.398477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68195334-a0fd-439d-b131-dd8cde23a3fd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.400087 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b649cc47a2a94de399da0f23583c766f, group_id=630f36be79ec406cb7dc9a08070d245a, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.401334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 19:52:57.401334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 19:52:57.401334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 19:52:57.403757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.405826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.406609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.406983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.407350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.408588 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.410579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.412636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 142/273] 10.222.0.18 () {56 vars in 1201 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.413580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.422259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 132/274] 10.222.0.18 () {58 vars in 1463 bytes} [Sun Oct 23 19:52:57 2022] PUT /identity/v3/projects/b649cc47a2a94de399da0f23583c766f/groups/630f36be79ec406cb7dc9a08070d245a/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:57.423454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.427297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098b610-2a7c-4cc4-8cb9-f16cd6317bd8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.494690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.495528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.495898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.496257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.502176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.502176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.506223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 143/275] 10.222.0.18 () {56 vars in 1207 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.508778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.516877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290fc1-3232-4801-b927-266c3c263d59 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.522128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3770-8847-4b65-bb39-1536c9fa198b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.524589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.525399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.525777 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.526267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9/groups/630f36be79ec406cb7dc9a08070d245a/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.528499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7744e0548a433db28d5f5222cd16a9, group_id=630f36be79ec406cb7dc9a08070d245a, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.530375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 19:52:57.530375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 19:52:57.530375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 19:52:57.530936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.532063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.532482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.532904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.533079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.534998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.537230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.543351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 133/276] 10.222.0.18 () {56 vars in 1207 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:57.550053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.565898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 144/277] 10.222.0.18 () {58 vars in 1463 bytes} [Sun Oct 23 19:52:57 2022] PUT /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9/groups/630f36be79ec406cb7dc9a08070d245a/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:52:57.569418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124354f7-28f4-445c-9b52-bf420a988889 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:57.597345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:57.658071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:57.658848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:57.659126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:57.659398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f/groups/630f36be79ec406cb7dc9a08070d245a/roles/658c99e6ef4841b5844a33d88f1b2d68` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:57.661799 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b649cc47a2a94de399da0f23583c766f, group_id=630f36be79ec406cb7dc9a08070d245a, role_id=658c99e6ef4841b5844a33d88f1b2d68)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:57.664656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:57.689727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 134/278] 10.222.0.18 () {58 vars in 1463 bytes} [Sun Oct 23 19:52:57 2022] PUT /identity/v3/projects/b649cc47a2a94de399da0f23583c766f/groups/630f36be79ec406cb7dc9a08070d245a/roles/658c99e6ef4841b5844a33d88f1b2d68 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:57.868449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:57.941418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:57.998146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bb159-ead0-4db8-82bd-ddb8633196ad admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:58.047388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:58.048409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.048883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.049355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.063436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:58.068904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:58.069779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 19:52:58.070637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:58.073172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 145/279] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:52:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:58.083284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:58.219944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075b117-8029-45f1-b0b1-c60d41f4e50b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:58.268641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c58843-539b-4379-8186-5e7b51b69651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:58.269251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c58843-539b-4379-8186-5e7b51b69651 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.269529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c58843-539b-4379-8186-5e7b51b69651 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.269797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c58843-539b-4379-8186-5e7b51b69651 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.270486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c58843-539b-4379-8186-5e7b51b69651 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:58.270784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c58843-539b-4379-8186-5e7b51b69651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:58.272140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c58843-539b-4379-8186-5e7b51b69651 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:58.281909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 135/280] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:52:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:58.287990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:58.436996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1316b0-75a8-49c1-ab9c-f5a218cdc641 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:58.461782 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:58.477482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed0341-a306-44f1-a72e-f66b086a59fb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.478073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed0341-a306-44f1-a72e-f66b086a59fb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.478632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed0341-a306-44f1-a72e-f66b086a59fb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.480483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 136/281] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:58.486531 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68e28d-e578-4e78-a62d-4a9066dc002a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.487153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68e28d-e578-4e78-a62d-4a9066dc002a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.487722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68e28d-e578-4e78-a62d-4a9066dc002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.492367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:58.492367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.492367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.492367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] PATH_INFO: `/v3/users/3f30d90d98d34e9f98397d096a80348f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.493071 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] RBAC: Authorizing `identity:get_user(user_id=3f30d90d98d34e9f98397d096a80348f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:58.494658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:58.496347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 146/282] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:52:58 2022] GET /identity/v3/users/3f30d90d98d34e9f98397d096a80348f => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:58.503028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:58.517703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ab68e28d-e578-4e78-a62d-4a9066dc002a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:58.519256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ab68e28d-e578-4e78-a62d-4a9066dc002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:58.550303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:58.625726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 137/283] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 19:52:58.656382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e8a5-b981-4aa2-8c17-76d2f5788608 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:58.699755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0df41b-4241-4b2a-b59b-8abae1f4f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:58.700362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df41b-4241-4b2a-b59b-8abae1f4f76f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.700640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df41b-4241-4b2a-b59b-8abae1f4f76f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.701519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0df41b-4241-4b2a-b59b-8abae1f4f76f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.702638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0df41b-4241-4b2a-b59b-8abae1f4f76f None admin] RBAC: Adding query filter params (role.id=481205a2142b44eab56a5217d0724061, user.id=3f30d90d98d34e9f98397d096a80348f, scope.system=all) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:58.702951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0df41b-4241-4b2a-b59b-8abae1f4f76f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:58.704378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0df41b-4241-4b2a-b59b-8abae1f4f76f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:58.721736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 147/284] 10.222.0.18 () {56 vars in 1308 bytes} [Sun Oct 23 19:52:58 2022] GET /identity/v3/role_assignments?user.id=3f30d90d98d34e9f98397d096a80348f&scope.system=all&role.id=481205a2142b44eab56a5217d0724061 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:58.934780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bf71-1361-4a38-b15f-ab3ef966bcf9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.935156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bf71-1361-4a38-b15f-ab3ef966bcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.935722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23bf71-1361-4a38-b15f-ab3ef966bcf9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.937556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 138/285] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:52:58.943134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e178fa-5e50-46ab-a0b0-c7a38c03e732 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:58.943421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e178fa-5e50-46ab-a0b0-c7a38c03e732 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:58.943695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e178fa-5e50-46ab-a0b0-c7a38c03e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:58.966519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-93e178fa-5e50-46ab-a0b0-c7a38c03e732 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:52:58.968480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-93e178fa-5e50-46ab-a0b0-c7a38c03e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:52:58.977314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 148/286] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:52:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 19:52:59.171981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23bf71-1361-4a38-b15f-ab3ef966bcf9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.187269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23bf71-1361-4a38-b15f-ab3ef966bcf9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.191765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.192399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.192681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.192958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.205084 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:59.209999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:59.210895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:52:59.211705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 139/287] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:59.218947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e178fa-5e50-46ab-a0b0-c7a38c03e732 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.228803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e178fa-5e50-46ab-a0b0-c7a38c03e732 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.235421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.236206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.236504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.236780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.237459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:59.238587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.239381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.251004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 149/288] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:59.256603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.269516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b759422-fbcf-4632-83c2-12f490b139ee admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.276157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.276835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.277121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.277396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.278585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.279862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 19:52:59.279862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 19:52:59.279862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 19:52:59.281117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.283752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.290851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 140/289] 10.222.0.18 () {56 vars in 1201 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:59.298558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db38efd-cace-4056-9a47-2c48f7eb8794 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.300608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.309049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.309840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.310132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.311922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.318007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbd062-798e-4368-b47f-106bcd124687 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.328173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.330402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.330686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.330965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.332909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.333581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:52:59.336965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.342527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 141/290] 10.222.0.18 () {56 vars in 1207 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:52:59.343227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:52:59.345602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:52:59.347612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 150/291] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:52:59.350816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.352306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.360955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621df92-c41e-401c-9e2f-3a89719b9225 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.366261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe44ef-3559-454b-b024-ca9d09972aff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.370141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.370141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.370141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.370141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9/groups/630f36be79ec406cb7dc9a08070d245a/roles/658c99e6ef4841b5844a33d88f1b2d68` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.372373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7744e0548a433db28d5f5222cd16a9, group_id=630f36be79ec406cb7dc9a08070d245a, role_id=658c99e6ef4841b5844a33d88f1b2d68)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.375824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.376634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.377466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.377945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.378439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.379318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:52:59.379702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.381845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.395203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 142/292] 10.222.0.18 () {58 vars in 1463 bytes} [Sun Oct 23 19:52:59 2022] PUT /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9/groups/630f36be79ec406cb7dc9a08070d245a/roles/658c99e6ef4841b5844a33d88f1b2d68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:52:59.398168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 151/293] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:59.401768 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.486608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57afb4-a9ae-4639-9557-fcf3cb8034ed admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.493172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.494043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.494544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.494995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] PATH_INFO: `/v3/groups/12edc5d6293c4ceca335837542a66425` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.504753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] RBAC: Authorizing `identity:get_group(group_id=12edc5d6293c4ceca335837542a66425)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.507020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.508999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 143/294] 10.222.0.18 () {56 vars in 1201 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/groups/12edc5d6293c4ceca335837542a66425 => generated 229 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:52:59.514732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.526376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:52:59.531340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e6c4b-cde7-489d-90fa-16fa1a706b5a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.541895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fedc16-50e8-44df-9f16-959ec9cf4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.542670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedc16-50e8-44df-9f16-959ec9cf4fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.543028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedc16-50e8-44df-9f16-959ec9cf4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.543375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedc16-50e8-44df-9f16-959ec9cf4fb0 admin admin] PATH_INFO: `/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.546401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fedc16-50e8-44df-9f16-959ec9cf4fb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=91c902e0ebe349a8bcb2a7801a9ea6fd)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.548369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fedc16-50e8-44df-9f16-959ec9cf4fb0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.550586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 152/295] 10.222.0.18 () {56 vars in 1207 bytes} [Sun Oct 23 19:52:59 2022] GET /identity/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:52:59.556036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:52:59.569463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85082-4f63-4f78-b323-89035b018b0d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:52:59.577247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a35295-6218-44b8-a3c3-803b9ae3b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:52:59.578306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a35295-6218-44b8-a3c3-803b9ae3b1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:52:59.578764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a35295-6218-44b8-a3c3-803b9ae3b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:52:59.579239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a35295-6218-44b8-a3c3-803b9ae3b1b0 admin admin] PATH_INFO: `/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd/groups/12edc5d6293c4ceca335837542a66425/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:52:59.582818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a35295-6218-44b8-a3c3-803b9ae3b1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c902e0ebe349a8bcb2a7801a9ea6fd, group_id=12edc5d6293c4ceca335837542a66425, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:52:59.585856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a35295-6218-44b8-a3c3-803b9ae3b1b0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:52:59.611865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 144/296] 10.222.0.18 () {58 vars in 1463 bytes} [Sun Oct 23 19:52:59 2022] PUT /identity/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd/groups/12edc5d6293c4ceca335837542a66425/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:00.818492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59efd3-1c09-4650-911a-4307cdc4b7d6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:00.819014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59efd3-1c09-4650-911a-4307cdc4b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:00.819091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59efd3-1c09-4650-911a-4307cdc4b7d6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:00.820709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 153/297] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:00.827223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d853276-d5eb-4b58-a4e7-2fca5e53886d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:00.827704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d853276-d5eb-4b58-a4e7-2fca5e53886d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:00.827775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d853276-d5eb-4b58-a4e7-2fca5e53886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:00.855235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0d853276-d5eb-4b58-a4e7-2fca5e53886d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:00.856385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0d853276-d5eb-4b58-a4e7-2fca5e53886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:00.926622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:00.935059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 145/298] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:53:00.971602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c5d4-27a4-445d-8c52-d07225b0e08f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:00.971927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c5d4-27a4-445d-8c52-d07225b0e08f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:00.972171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c5d4-27a4-445d-8c52-d07225b0e08f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:00.973654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 154/299] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:00.978906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02219-784e-47d9-af32-5d7c30b85e40 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:00.979198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02219-784e-47d9-af32-5d7c30b85e40 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:00.979480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02219-784e-47d9-af32-5d7c30b85e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.003060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a0a02219-784e-47d9-af32-5d7c30b85e40 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:01.004256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a0a02219-784e-47d9-af32-5d7c30b85e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:01.089011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 146/300] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:01.203126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3a9ac-7454-4bbd-b11f-c903da2b403f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:01.203746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3a9ac-7454-4bbd-b11f-c903da2b403f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:01.204235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3a9ac-7454-4bbd-b11f-c903da2b403f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.205999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 155/301] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:01.212343 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b709f9b-9d2a-44d8-b654-0ee24f597510 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:01.212618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b709f9b-9d2a-44d8-b654-0ee24f597510 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:01.212899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b709f9b-9d2a-44d8-b654-0ee24f597510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.231992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8b709f9b-9d2a-44d8-b654-0ee24f597510 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:01.233748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8b709f9b-9d2a-44d8-b654-0ee24f597510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:01.314900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 147/302] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:01.320640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3a9ac-7454-4bbd-b11f-c903da2b403f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:01.437118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3a9ac-7454-4bbd-b11f-c903da2b403f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:01.478910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:01.479481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:01.479771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:01.480052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.491339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:01.496739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:01.497618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:01.498975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 156/303] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:01.505702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b709f9b-9d2a-44d8-b654-0ee24f597510 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:01.519317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:01.573078 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:01.596833 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:01.664102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b709f9b-9d2a-44d8-b654-0ee24f597510 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:01.681868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a7050-4cdc-4e7b-8137-9862def8a031 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:01.729611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:01.730329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:01.730617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:01.730896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.731571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:01.731878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:01.734435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:01.746644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 148/304] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:53:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:01.748354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:01.748998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:01.749273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:01.749545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.753640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:01.772521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:01.779448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:01.780761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:01.781882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 157/305] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:01.791670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:01.917422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e5c6f-51a7-48a0-ae10-0405df0dc8f5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:01.931403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edc984-3db9-4ea0-b29d-b2346970a6a9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:01.939100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:01.957348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:01.960903 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:01.962532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:01.963384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:01.963813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.980591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:01.981282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:01.981656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:01.982022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:01.983204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:01.983844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:01.985175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:01.993737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 158/306] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:01.999299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:02.049101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:02.051544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:02.126834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6762493-e0c0-4cdf-95fe-6eb7e14797b9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:02.164513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:02.165237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.165619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.166042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.176677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 149/307] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:02.177743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:02.180038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:02.186284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:02.187504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:02.188398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 159/308] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:02.189067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:02.203704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:02.252280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:02.321375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580eb0d-63e5-414a-9e3e-0e5d682a8e77 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:02.326850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541c706-8861-4fb0-8e52-002437d8ae93 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:02.370184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:02.371083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dd82f-2273-4690-a5a2-2f1d4e9dbe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:02.371214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.371654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.371895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd82f-2273-4690-a5a2-2f1d4e9dbe17 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.372218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.372327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd82f-2273-4690-a5a2-2f1d4e9dbe17 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.372512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd82f-2273-4690-a5a2-2f1d4e9dbe17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.374032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:02.375828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:02.378416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 160/309] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:53:02 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:02.379443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:02.454706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dd82f-2273-4690-a5a2-2f1d4e9dbe17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:02.456228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dd82f-2273-4690-a5a2-2f1d4e9dbe17 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:02.477027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:02.507184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a1ce2-1aa1-431e-b96b-e30cb6917ac6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:02.518574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:02.547775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ce5d0-b3c5-4181-9765-96b38d98a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:02.548391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce5d0-b3c5-4181-9765-96b38d98a852 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.549022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce5d0-b3c5-4181-9765-96b38d98a852 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.549305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce5d0-b3c5-4181-9765-96b38d98a852 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.549982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ce5d0-b3c5-4181-9765-96b38d98a852 None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:02.550322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ce5d0-b3c5-4181-9765-96b38d98a852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:02.552056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ce5d0-b3c5-4181-9765-96b38d98a852 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:02.565073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 161/310] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:53:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:02.566747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e5e4-2139-464e-b821-ac70c59dd679 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.567041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e5e4-2139-464e-b821-ac70c59dd679 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.567476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e5e4-2139-464e-b821-ac70c59dd679 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.568720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 162/311] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:02.569422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536e5e4-2139-464e-b821-ac70c59dd679 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:02.582175 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 150/312] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:02.583797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343d8d-759c-4a82-af03-56b9605b76f9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.584262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343d8d-759c-4a82-af03-56b9605b76f9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.584708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343d8d-759c-4a82-af03-56b9605b76f9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.586141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 151/313] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:02.587032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343d8d-759c-4a82-af03-56b9605b76f9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:02.696157 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536e5e4-2139-464e-b821-ac70c59dd679 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:02.710243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343d8d-759c-4a82-af03-56b9605b76f9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:02.731538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:02.735075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff346025-6b7e-4f63-9e85-c0ce8ac10be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:02.735707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff346025-6b7e-4f63-9e85-c0ce8ac10be0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.735989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff346025-6b7e-4f63-9e85-c0ce8ac10be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.736338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff346025-6b7e-4f63-9e85-c0ce8ac10be0 None admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.739213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff346025-6b7e-4f63-9e85-c0ce8ac10be0 None admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:02.740680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff346025-6b7e-4f63-9e85-c0ce8ac10be0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:02.742333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 163/314] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Oct 23 19:53:02 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:02.743475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6492-2169-4ea5-87f9-f29ad3b9d257 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.743757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6492-2169-4ea5-87f9-f29ad3b9d257 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.744029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6492-2169-4ea5-87f9-f29ad3b9d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.758939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c84f-2bc9-498e-bd63-8063b0919dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:02.758939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c84f-2bc9-498e-bd63-8063b0919dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.758939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c84f-2bc9-498e-bd63-8063b0919dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.758939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c84f-2bc9-498e-bd63-8063b0919dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.764041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c0dc6492-2169-4ea5-87f9-f29ad3b9d257 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:02.765371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c0dc6492-2169-4ea5-87f9-f29ad3b9d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:02.806241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:02.842206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c84f-2bc9-498e-bd63-8063b0919dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:02.843965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c84f-2bc9-498e-bd63-8063b0919dc2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:02.849631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 164/315] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:02.849631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6492-2169-4ea5-87f9-f29ad3b9d257 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:02.966344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 152/316] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:02.968755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635317f7-d31d-47e9-af7d-d5cacf9326d4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:02.969007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6492-2169-4ea5-87f9-f29ad3b9d257 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:02.969611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635317f7-d31d-47e9-af7d-d5cacf9326d4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:02.970029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635317f7-d31d-47e9-af7d-d5cacf9326d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:02.987979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-635317f7-d31d-47e9-af7d-d5cacf9326d4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:02.989391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-635317f7-d31d-47e9-af7d-d5cacf9326d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:03.007138 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.013988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.015172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.015526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.015798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] PATH_INFO: `/v3/projects/b649cc47a2a94de399da0f23583c766f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.016933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] RBAC: Authorizing `identity:get_project(project_id=b649cc47a2a94de399da0f23583c766f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.018389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.020173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 165/317] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:53:02 2022] GET /identity/v3/projects/b649cc47a2a94de399da0f23583c766f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.021918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.066067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.074337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 153/318] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:03.075427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635317f7-d31d-47e9-af7d-d5cacf9326d4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.137797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b7591-709b-43b2-aef5-554d775beb20 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.178554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.179586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.180065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.180535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.181514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] RBAC: Adding query filter params (group.id=630f36be79ec406cb7dc9a08070d245a, role.id=a1d711c0f4c7442ebc3831a3489bcd58, scope.project.id=b649cc47a2a94de399da0f23583c766f) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:03.182158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.183784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.198117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 166/319] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/role_assignments?group.id=630f36be79ec406cb7dc9a08070d245a&scope.project.id=b649cc47a2a94de399da0f23583c766f&role.id=a1d711c0f4c7442ebc3831a3489bcd58 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.198117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.198365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635317f7-d31d-47e9-af7d-d5cacf9326d4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.242827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.243474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.243805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.244035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.245744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.247890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.251824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 154/320] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.252735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.281948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.329793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4d4ad-3f25-43d1-bb68-c92fc197c013 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.331675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.373706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.374407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.374688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.374961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.376821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.378357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.380379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 167/321] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.381057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.404757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373d29-2979-4b84-88d2-36053b7fc8b3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.450033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.451172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.451738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.452188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.463192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:03.468882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:03.469830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:03.470653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 155/322] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:03.471336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.507991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fe3aa-7d55-4efe-86ac-e181231fdb89 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.547437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.547997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.548279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.548552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.549655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.551623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.552703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 168/323] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.558770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.561320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.590816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f06f-add8-48c9-9251-392a791b6218 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.610984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.641925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.642560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.642837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.643106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.643835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] RBAC: Adding query filter params (group.id=630f36be79ec406cb7dc9a08070d245a, role.id=658c99e6ef4841b5844a33d88f1b2d68, scope.project.id=b649cc47a2a94de399da0f23583c766f) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:03.644139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.645570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.651927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 156/324] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/role_assignments?group.id=630f36be79ec406cb7dc9a08070d245a&scope.project.id=b649cc47a2a94de399da0f23583c766f&role.id=658c99e6ef4841b5844a33d88f1b2d68 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.659050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.698814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc966cd-14da-4152-a7f7-541631ba0bf7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.738819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.739459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.739736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.740005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.753126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:03.758805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:03.759727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:03.760515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 169/325] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:03.761165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.774809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a89b-2a8b-4e65-a959-15230e01c134 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.812835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.813414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.813642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.813914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.814632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:03.814939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.816330 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.830126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 157/326] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.830126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.831165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.871174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:03.877697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8cfe0-0e17-4811-98ac-939eb4cc1a0f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:03.918964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:03.919273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:03.919553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:03.920347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:03.921172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] RBAC: Adding query filter params (group.id=630f36be79ec406cb7dc9a08070d245a, role.id=a1d711c0f4c7442ebc3831a3489bcd58, scope.project.id=1d7744e0548a433db28d5f5222cd16a9) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:03.921489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:03.922982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:03.931460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 170/327] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/role_assignments?group.id=630f36be79ec406cb7dc9a08070d245a&scope.project.id=1d7744e0548a433db28d5f5222cd16a9&role.id=a1d711c0f4c7442ebc3831a3489bcd58 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:03.932416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:03.955218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569cfe-a05a-4907-a840-0258907212e9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.010870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.011833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.012199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.012938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.013857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:04.013857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.015850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.025485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 158/328] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:04.032949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:04.077627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2346-a5f3-4f5c-a362-09ac7c7acb5b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.114939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:04.122280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.122978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.123412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.123751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.158113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baa65e-18ee-418d-966e-3eb630659973 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.160824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:04.203875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.205562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.205562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.205562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.208269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.209879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.288614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.290712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.327747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 171/329] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:04.334103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:04.359618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:04.394439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:04.398536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 159/330] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 19:53:04.404614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:04.433430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826f90-45ac-498f-8ef1-89dc52728bd3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.468895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.469514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.469789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.470055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] PATH_INFO: `/v3/projects/1d7744e0548a433db28d5f5222cd16a9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.471253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] RBAC: Authorizing `identity:get_project(project_id=1d7744e0548a433db28d5f5222cd16a9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.472781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.474525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 172/331] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:53:04 2022] GET /identity/v3/projects/1d7744e0548a433db28d5f5222cd16a9 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:04.479935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:04.502699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a2f3a-d70d-4691-9418-bc89355cc045 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.537879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.538532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.538807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.539074 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] PATH_INFO: `/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.540181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] RBAC: Authorizing `identity:get_project(project_id=91c902e0ebe349a8bcb2a7801a9ea6fd)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.541594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.543227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 160/332] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:53:04 2022] GET /identity/v3/projects/91c902e0ebe349a8bcb2a7801a9ea6fd => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:04.549241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:04.580666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:04.581546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626600-2892-4585-bfb3-7867516372ee None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.610914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:04.616897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.617528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.617809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.618101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] PATH_INFO: `/v3/groups/630f36be79ec406cb7dc9a08070d245a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.619201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] RBAC: Authorizing `identity:get_group(group_id=630f36be79ec406cb7dc9a08070d245a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.620632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.622318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 173/333] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Oct 23 19:53:04 2022] GET /identity/v3/groups/630f36be79ec406cb7dc9a08070d245a => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:04.628609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:04.653478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee213e-5974-456c-9824-fe68d493238b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.687803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.688437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.688722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.688996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] PATH_INFO: `/v3/groups/12edc5d6293c4ceca335837542a66425` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.690119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] RBAC: Authorizing `identity:get_group(group_id=12edc5d6293c4ceca335837542a66425)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.691542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.693107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 161/334] 10.222.0.18 () {56 vars in 1180 bytes} [Sun Oct 23 19:53:04 2022] GET /identity/v3/groups/12edc5d6293c4ceca335837542a66425 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:04.698917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:04.726320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc89a-8845-4d02-bcfb-1ec65432be86 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.759606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33b7a2-33d6-4a8a-8c26-77d2fa467ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.760194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33b7a2-33d6-4a8a-8c26-77d2fa467ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.760476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33b7a2-33d6-4a8a-8c26-77d2fa467ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.760746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33b7a2-33d6-4a8a-8c26-77d2fa467ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.761461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33b7a2-33d6-4a8a-8c26-77d2fa467ec2 None admin] RBAC: Adding query filter params (group.id=630f36be79ec406cb7dc9a08070d245a, role.id=658c99e6ef4841b5844a33d88f1b2d68, scope.project.id=1d7744e0548a433db28d5f5222cd16a9) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:04.761763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33b7a2-33d6-4a8a-8c26-77d2fa467ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.763209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33b7a2-33d6-4a8a-8c26-77d2fa467ec2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.769349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 174/335] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Oct 23 19:53:04 2022] GET /identity/v3/role_assignments?group.id=630f36be79ec406cb7dc9a08070d245a&scope.project.id=1d7744e0548a433db28d5f5222cd16a9&role.id=658c99e6ef4841b5844a33d88f1b2d68 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:04.793444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:04.797822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f830a-26c1-4c5f-808f-9175d78406c8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:04.835528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44bd6-c98d-4052-8c8b-e17bfae718d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:04.836047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44bd6-c98d-4052-8c8b-e17bfae718d2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:04.836332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44bd6-c98d-4052-8c8b-e17bfae718d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:04.836604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44bd6-c98d-4052-8c8b-e17bfae718d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:04.837336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44bd6-c98d-4052-8c8b-e17bfae718d2 None admin] RBAC: Adding query filter params (group.id=12edc5d6293c4ceca335837542a66425, role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=91c902e0ebe349a8bcb2a7801a9ea6fd) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:04.837644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44bd6-c98d-4052-8c8b-e17bfae718d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:04.839124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44bd6-c98d-4052-8c8b-e17bfae718d2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:04.845992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 162/336] 10.222.0.18 () {56 vars in 1376 bytes} [Sun Oct 23 19:53:04 2022] GET /identity/v3/role_assignments?group.id=12edc5d6293c4ceca335837542a66425&scope.project.id=91c902e0ebe349a8bcb2a7801a9ea6fd&role.id=33f053640f414ee688b1cbf6d6707471 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:07.615648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f9bb4-cbbd-4e58-bbf2-3b00db2ece14 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:07.616673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f9bb4-cbbd-4e58-bbf2-3b00db2ece14 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:07.617169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f9bb4-cbbd-4e58-bbf2-3b00db2ece14 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:07.618882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 175/337] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:07 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:07.624736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caecb3-ed7f-490b-bb47-3e1e95bc0550 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:07.625614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caecb3-ed7f-490b-bb47-3e1e95bc0550 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:07.626132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caecb3-ed7f-490b-bb47-3e1e95bc0550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:07.655904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-56caecb3-ed7f-490b-bb47-3e1e95bc0550 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:07.657521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-56caecb3-ed7f-490b-bb47-3e1e95bc0550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:07.752399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 163/338] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:07.791306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aec3c-580a-4061-a800-3bfffa311b9b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:07.791648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aec3c-580a-4061-a800-3bfffa311b9b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:07.791857 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aec3c-580a-4061-a800-3bfffa311b9b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:07.793426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 176/339] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:07.799627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fa737-c111-442a-84c4-50a50d95d3bd None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:07.799917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fa737-c111-442a-84c4-50a50d95d3bd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:07.800194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fa737-c111-442a-84c4-50a50d95d3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:07.823108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-264fa737-c111-442a-84c4-50a50d95d3bd None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:07.824654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-264fa737-c111-442a-84c4-50a50d95d3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:07.920643 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 164/340] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:08.149937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f6ca6-bb7c-4bf8-963b-d0b6e67ee713 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.150330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f6ca6-bb7c-4bf8-963b-d0b6e67ee713 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.150529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f6ca6-bb7c-4bf8-963b-d0b6e67ee713 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.152105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 177/341] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:08.163418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35dc6-e0d8-4d82-a4b0-e304ab1f3037 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.163709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35dc6-e0d8-4d82-a4b0-e304ab1f3037 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.163987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35dc6-e0d8-4d82-a4b0-e304ab1f3037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.190571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-22d35dc6-e0d8-4d82-a4b0-e304ab1f3037 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:08.191683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-22d35dc6-e0d8-4d82-a4b0-e304ab1f3037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:08.208431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f6ca6-bb7c-4bf8-963b-d0b6e67ee713 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.214936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:08.278244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:08.279893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 165/342] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:08.281634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35dc6-e0d8-4d82-a4b0-e304ab1f3037 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.329660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f6ca6-bb7c-4bf8-963b-d0b6e67ee713 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:08.366783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb438c-520b-4bb2-bdad-0535febabc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:08.367517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb438c-520b-4bb2-bdad-0535febabc90 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.367807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb438c-520b-4bb2-bdad-0535febabc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.368083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb438c-520b-4bb2-bdad-0535febabc90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.380473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb438c-520b-4bb2-bdad-0535febabc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:08.382039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb438c-520b-4bb2-bdad-0535febabc90 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-dedb438c-520b-4bb2-bdad-0535febabc90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:08.399434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:08.400410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:08.401288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:08.401288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:08.401288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:08.401463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35dc6-e0d8-4d82-a4b0-e304ab1f3037 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:08.402039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 178/343] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:08.402216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11766cf-3fc7-4d76-a440-8e22d85e8d02 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.405456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11766cf-3fc7-4d76-a440-8e22d85e8d02 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.405456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11766cf-3fc7-4d76-a440-8e22d85e8d02 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.408674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 179/344] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:08.409484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11766cf-3fc7-4d76-a440-8e22d85e8d02 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.439734 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d09614-67f4-475b-b1ff-11850ba0699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:08.440369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09614-67f4-475b-b1ff-11850ba0699b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.440707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09614-67f4-475b-b1ff-11850ba0699b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.440927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09614-67f4-475b-b1ff-11850ba0699b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.453657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d09614-67f4-475b-b1ff-11850ba0699b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:08.455166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d09614-67f4-475b-b1ff-11850ba0699b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-78d09614-67f4-475b-b1ff-11850ba0699b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:08.472871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:08.474986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:08.476590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:08.476590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:08.476590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:08.476590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 166/345] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:08.476590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04938-c08d-4dc3-9b6e-bb6a194e1be2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.476590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04938-c08d-4dc3-9b6e-bb6a194e1be2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.476590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04938-c08d-4dc3-9b6e-bb6a194e1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.493245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:08.500128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-58e04938-c08d-4dc3-9b6e-bb6a194e1be2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:08.501337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-58e04938-c08d-4dc3-9b6e-bb6a194e1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:08.526261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11766cf-3fc7-4d76-a440-8e22d85e8d02 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:08.542169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:08.566601 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:08.567200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.567538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.567829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.568475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:08.568780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:08.570182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:08.577826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 167/346] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:08.577826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04938-c08d-4dc3-9b6e-bb6a194e1be2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.583361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 180/347] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:08.584058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.693145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04938-c08d-4dc3-9b6e-bb6a194e1be2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:08.696982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804ba18-7425-4255-8715-dad5f995f046 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:08.732535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:08.733251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.733604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.733952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.734713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:08.735095 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:08.735381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:08.736409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.736673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:08.737083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.737527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.739400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:08.751101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 168/348] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:08.751288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:08.752077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.753298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:08.777509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:08.778532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:08.780090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:08.780090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:08.780090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:08.780090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 181/349] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:08.781064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.830545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:08.868217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575957a9-f9f8-4691-9e5f-cb9df9d35da9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:08.899722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc1078-3e76-4a1d-96ae-7529e9cf383d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:08.905455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:08.906065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.906372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.906644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.907292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:08.908721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:08.932117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 169/350] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:53:08 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:08.933157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:08.953980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:08.955018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:08.955484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:08.955858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:08.956961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:08.959120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:08.992484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 182/351] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:53:08 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:08.993609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:09.021466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:09.093438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428bef6-a5b5-4e5a-b8a0-325ceb01b7a2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:09.121142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:09.154612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21187c4-13d5-4f45-9cec-1d35cb495a22 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:09.155644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:09.156291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:09.156574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:09.156850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:09.157521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:09.157831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:09.159316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:09.184364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 170/352] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:09.188413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:09.223053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:09.223849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:09.224702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:09.224983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:09.241042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:09.242584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:09.265557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:09.266540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:09.267383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:09.267383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:09.267383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:09.267862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 183/353] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:09.273497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:09.335887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e5f90-0e7d-4768-972a-85415f5cbd89 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:09.352242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:09.375134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de94626-2c76-4a61-b880-0d8df5ba2d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:09.375909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de94626-2c76-4a61-b880-0d8df5ba2d15 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:09.376288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de94626-2c76-4a61-b880-0d8df5ba2d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:09.376658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de94626-2c76-4a61-b880-0d8df5ba2d15 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:09.377437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de94626-2c76-4a61-b880-0d8df5ba2d15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:09.379598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de94626-2c76-4a61-b880-0d8df5ba2d15 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:09.401693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde328d-412c-4276-b4d3-3e6b1392d4c9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:09.405954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 171/354] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:53:09 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:09.407527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60338-2bed-4aa6-8428-e228da286a28 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:09.407924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60338-2bed-4aa6-8428-e228da286a28 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:09.408351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba60338-2bed-4aa6-8428-e228da286a28 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:09.409878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 172/355] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:09.415528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2493-d6ba-4911-9814-2106fd8021ff None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:09.415826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2493-d6ba-4911-9814-2106fd8021ff None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:09.416103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2493-d6ba-4911-9814-2106fd8021ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:09.453902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-81eb2493-d6ba-4911-9814-2106fd8021ff None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:09.455952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-81eb2493-d6ba-4911-9814-2106fd8021ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:09.478712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:09.479256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:09.479536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:09.479809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:09.480470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:09.480774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:09.482369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:09.484190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:09.499422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 184/356] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:09.505657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:09.632754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 173/357] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:09.668236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752750-a0c9-4eb7-a5d8-056fed6607f3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:09.705950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:09.706799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:09.707089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:09.707370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:09.708053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:09.709499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:09.733942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 185/358] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:53:09 2022] POST /identity/v3/users => generated 249 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:09.928941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2493-d6ba-4911-9814-2106fd8021ff None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:10.036532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:10.040599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2493-d6ba-4911-9814-2106fd8021ff None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:10.082389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:10.083003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:10.083286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:10.083620 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:10.084305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:10.085675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:10.094010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.sql.core [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 19:53:10.094010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 19:53:10.094010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [parameters: {'id': 'c0650705f1fc465e8d371141f77a0b8b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 19:53:10.094010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:53:10.101502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return ref.to_dict() Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:53:10.102378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application yield resource Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise self.value Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application session.commit() Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 19:53:10.103278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.flush() Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application compat.raise_( Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 19:53:10.104617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:53:10.105431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:53:10.106896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [parameters: {'id': 'c0650705f1fc465e8d371141f77a0b8b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:10.109557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 19:53:10.115694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:10.117638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 174/359] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Oct 23 19:53:09 2022] POST /identity/v3/roles => generated 144 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:10.117769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:10.165253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:10.227986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7988ec-e273-4ecc-8b91-3c2acdc6462f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:10.275698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8b435-cc8d-4e19-a974-3046618337bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:10.276340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b435-cc8d-4e19-a974-3046618337bf None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:10.276622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b435-cc8d-4e19-a974-3046618337bf None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:10.276899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b435-cc8d-4e19-a974-3046618337bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:10.288365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8b435-cc8d-4e19-a974-3046618337bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-28b8b435-cc8d-4e19-a974-3046618337bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:10.293712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:10.294712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:10.295536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 186/360] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:10.303578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:10.421363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88aa79-155c-41e5-8423-33582754c4ec None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:10.463520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521a9b7-1422-4a55-8e45-b461e0b65503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:10.464745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a9b7-1422-4a55-8e45-b461e0b65503 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:10.465379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a9b7-1422-4a55-8e45-b461e0b65503 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:10.465986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a9b7-1422-4a55-8e45-b461e0b65503 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:10.467701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521a9b7-1422-4a55-8e45-b461e0b65503 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:10.468109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521a9b7-1422-4a55-8e45-b461e0b65503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:10.469900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521a9b7-1422-4a55-8e45-b461e0b65503 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:10.479451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 175/361] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:11.488052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661c3f-3647-46ec-aaeb-3d4758b237e2 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:11.489118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661c3f-3647-46ec-aaeb-3d4758b237e2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:11.489609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15661c3f-3647-46ec-aaeb-3d4758b237e2 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:11.491270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 187/362] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:11.497267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b55e7-4439-4733-8106-a6cecec87c5b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:11.498342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b55e7-4439-4733-8106-a6cecec87c5b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:11.498883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b55e7-4439-4733-8106-a6cecec87c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:11.526663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c64b55e7-4439-4733-8106-a6cecec87c5b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:11.527878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c64b55e7-4439-4733-8106-a6cecec87c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:11.547633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:11.595239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19615e-9220-4752-b807-fcece4f2af6e None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:11.595554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19615e-9220-4752-b807-fcece4f2af6e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:11.595790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19615e-9220-4752-b807-fcece4f2af6e None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:11.597260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 188/363] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:53:11.603677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7475e3-a418-4e9e-8394-332b0cd81b98 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:11.603818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 176/364] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:11.603963 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7475e3-a418-4e9e-8394-332b0cd81b98 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:11.604233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7475e3-a418-4e9e-8394-332b0cd81b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:11.636532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ca7475e3-a418-4e9e-8394-332b0cd81b98 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:11.637824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ca7475e3-a418-4e9e-8394-332b0cd81b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:11.731969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 189/365] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:53:11.973691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b55e7-4439-4733-8106-a6cecec87c5b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.085582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b55e7-4439-4733-8106-a6cecec87c5b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.127787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.128791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.129272 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.129744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.134024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7475e3-a418-4e9e-8394-332b0cd81b98 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.145238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:12.159053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:12.159979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:12.160759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:12.163083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 177/366] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:12.168678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.180518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:12.191619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:12.244636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7475e3-a418-4e9e-8394-332b0cd81b98 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.284463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.285444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.285941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.286524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.287982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbfe35-bc68-4eb3-a5d7-794c8d2261df None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.298264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:12.303357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:12.304217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:12.305005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:12.307511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 190/367] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:12.313605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.333228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.333852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.334157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.334434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.335229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:12.335417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:12.336877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:12.354569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 178/368] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:12.359080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.426675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:12.432098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255068c-578f-4973-be9a-6450c331fa3a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.449954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:12.477242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae69c8a-e1d4-42fd-b312-88ea9f5628c4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.477501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb424cc9-b8fe-43ad-9024-6908c4d416dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.478063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb424cc9-b8fe-43ad-9024-6908c4d416dd None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.478367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb424cc9-b8fe-43ad-9024-6908c4d416dd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.478638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb424cc9-b8fe-43ad-9024-6908c4d416dd None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.479573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb424cc9-b8fe-43ad-9024-6908c4d416dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:12.479897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb424cc9-b8fe-43ad-9024-6908c4d416dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:12.482392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb424cc9-b8fe-43ad-9024-6908c4d416dd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:12.493673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 191/369] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:12.495343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de0f1-ccb0-45e1-b764-1c3c4b92e981 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.495569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de0f1-ccb0-45e1-b764-1c3c4b92e981 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.495844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de0f1-ccb0-45e1-b764-1c3c4b92e981 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.502159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 192/370] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:12.502994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6de0f1-ccb0-45e1-b764-1c3c4b92e981 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.529863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c0a09-aa1e-41d3-b518-358bdbaf6c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.531824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0a09-aa1e-41d3-b518-358bdbaf6c94 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.532309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0a09-aa1e-41d3-b518-358bdbaf6c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.533050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0a09-aa1e-41d3-b518-358bdbaf6c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.549326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c0a09-aa1e-41d3-b518-358bdbaf6c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:12.551138 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c0a09-aa1e-41d3-b518-358bdbaf6c94 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-891c0a09-aa1e-41d3-b518-358bdbaf6c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:12.572547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:12.573474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:12.574339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:12.574339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:12.574339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:12.580587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 179/371] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:12.580587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f104327-6a1f-4ea3-b8ca-d1bbcd283357 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.580587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f104327-6a1f-4ea3-b8ca-d1bbcd283357 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.580587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f104327-6a1f-4ea3-b8ca-d1bbcd283357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.603539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3f104327-6a1f-4ea3-b8ca-d1bbcd283357 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:12.605598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3f104327-6a1f-4ea3-b8ca-d1bbcd283357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:12.641063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6de0f1-ccb0-45e1-b764-1c3c4b92e981 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.680131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.680588 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.680874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.681151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.694309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 180/372] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:12.694309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f104327-6a1f-4ea3-b8ca-d1bbcd283357 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.701266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:12.702845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:12.727122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:12.728060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:12.728893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:12.728893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:12.728893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:12.728893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 193/373] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:12.738033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:12.772172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:12.802005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:12.859197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f104327-6a1f-4ea3-b8ca-d1bbcd283357 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.883745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442942c-7f17-4f17-990a-83967391f58d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:12.897053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c84ca-272a-41b5-816d-71c33aa0ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.897838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c84ca-272a-41b5-816d-71c33aa0ec63 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.898151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c84ca-272a-41b5-816d-71c33aa0ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.898433 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c84ca-272a-41b5-816d-71c33aa0ec63 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.899243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c84ca-272a-41b5-816d-71c33aa0ec63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:12.899552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c84ca-272a-41b5-816d-71c33aa0ec63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:12.900928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c84ca-272a-41b5-816d-71c33aa0ec63 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:12.914016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 181/374] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:12.915388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb715b-2644-4f90-9926-d3fd8c954309 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.915679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb715b-2644-4f90-9926-d3fd8c954309 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.916053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb715b-2644-4f90-9926-d3fd8c954309 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.921716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 182/375] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:12.923350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97b0d8-e80b-4b81-8b30-ee53ae3d4b06 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.923640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97b0d8-e80b-4b81-8b30-ee53ae3d4b06 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.924015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97b0d8-e80b-4b81-8b30-ee53ae3d4b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.929573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:12.930322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:12.930607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:12.930968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:12.931623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:12.931983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:12.933350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:12.942568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9a97b0d8-e80b-4b81-8b30-ee53ae3d4b06 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:12.944148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9a97b0d8-e80b-4b81-8b30-ee53ae3d4b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:12.946800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 194/376] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:12.947793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.018217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 183/377] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:13.020004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97b0d8-e80b-4b81-8b30-ee53ae3d4b06 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.027939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.058933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690a5f2-28a7-49da-8829-2d61db24ea43 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.080148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.099746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.100380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.100787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.101198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.111509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.113808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:13.132366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:13.133331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:13.134257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:13.134839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97b0d8-e80b-4b81-8b30-ee53ae3d4b06 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.139817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 195/378] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Oct 23 19:53:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:13.141736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.185914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.187659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.187939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.188599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.196962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.198952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:13.217028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:13.217973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:13.219249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 184/379] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:13.219816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.259339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03dfb-c657-4b38-86c9-06cdf4d74089 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.309122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.309767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.310664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.311011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.313374 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.326426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:13.332877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:13.333732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:13.334556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:13.335160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 196/380] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:13.336272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.346810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d5ac6-d3ba-4b66-858d-a91b3753cbdb None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.358330 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.388969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.390110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.390602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.391080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.392244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:13.392780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.394543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.444418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 185/381] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:13.445133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ca8a-5410-49b5-bddc-86ae860c8814 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.445858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.481169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.482198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.482762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.482762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.483559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:13.483878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.485327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.523384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 197/382] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:13.524221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.555397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b620c30-15f2-4569-b819-6ca736532bf7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.580158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.588522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.589144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.589413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.589691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.599735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:13.604653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:13.605571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:13.606400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:13.607662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 186/383] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:13.608349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.633923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c276cf0-9e5d-41b6-afdf-5137518e8e0f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.634124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.668608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1164620-5ab5-41e5-a030-211f4add361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.669210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1164620-5ab5-41e5-a030-211f4add361a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.669829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1164620-5ab5-41e5-a030-211f4add361a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.670135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1164620-5ab5-41e5-a030-211f4add361a None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.670785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1164620-5ab5-41e5-a030-211f4add361a None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:13.671083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1164620-5ab5-41e5-a030-211f4add361a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.672460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1164620-5ab5-41e5-a030-211f4add361a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.680098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 198/384] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:13.681234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aec5f-59e7-4406-b2c4-6b77ec4c5ca2 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.681516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aec5f-59e7-4406-b2c4-6b77ec4c5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.681788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aec5f-59e7-4406-b2c4-6b77ec4c5ca2 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.683016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 199/385] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:13.683701 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aec5f-59e7-4406-b2c4-6b77ec4c5ca2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.711555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372127c0-4372-4866-bbd7-d9b320b81fe4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.744782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.745397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.745673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.745943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.756139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.757575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:13.773817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:13.780493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:13.781562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:13.781562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:13.781562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:13.781562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 187/386] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:13.781562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.792876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aec5f-59e7-4406-b2c4-6b77ec4c5ca2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.806481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.829629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.830326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.830558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.830831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.841324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.842916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.853723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:13.856750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:13.858446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:13.859406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:13.859406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:13.859406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:13.859406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 200/387] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:13.859406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:13.879981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7578a-00cf-40ee-8d57-a190a1c332aa None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.913695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b4dd1-8470-4a47-88de-8d16fa95886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.914320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b4dd1-8470-4a47-88de-8d16fa95886f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.914599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b4dd1-8470-4a47-88de-8d16fa95886f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.914873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b4dd1-8470-4a47-88de-8d16fa95886f None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.915522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b4dd1-8470-4a47-88de-8d16fa95886f None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:13.915824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b4dd1-8470-4a47-88de-8d16fa95886f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:13.917166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b4dd1-8470-4a47-88de-8d16fa95886f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:13.925543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 188/388] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:13.926691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59f3f-f6d5-4bee-a8a1-c50e51e16a63 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.926969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59f3f-f6d5-4bee-a8a1-c50e51e16a63 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.927242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59f3f-f6d5-4bee-a8a1-c50e51e16a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:13.944556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7df59f3f-f6d5-4bee-a8a1-c50e51e16a63 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:13.945747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7df59f3f-f6d5-4bee-a8a1-c50e51e16a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:13.964891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac251df-b1a5-4a86-bf71-403a1a059177 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:13.998628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:13.999242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:13.999521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:13.999799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.009871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 189/389] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:14.010038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.010733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59f3f-f6d5-4bee-a8a1-c50e51e16a63 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.011615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:14.026377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:14.027272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:14.034038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:14.034038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:14.034038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:14.034038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 201/390] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:14.034038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.049538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.098502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.130775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59f3f-f6d5-4bee-a8a1-c50e51e16a63 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.148308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b7daa-128c-4a61-b6e5-8c50d18e3a22 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.167449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.168054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.168332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.168600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.170151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:14.170619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.171986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.188400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 190/391] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:14.188400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.194826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.195435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.195712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.195983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.196623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:14.196928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.198354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.212556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 202/392] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:14.213175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.296151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dfde6-46e3-4009-a384-550be44fbea5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.299010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.320724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80607ebd-f334-4e0b-9186-16a8e7a05ab2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.324623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.331257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.331957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.332309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.332654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.344047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.345501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.355271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.355809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.356094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.356367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.357143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:14.357450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.359136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:14.359236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:14.360152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:14.360980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:14.360980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:14.360980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:14.360980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 191/393] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:14.361200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.375082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 203/394] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:14.375896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.460469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e0ef-328f-4657-98d1-144d35180f11 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.473267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76a077-fe30-4cc2-92e6-c13e46e8cdeb None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.493329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.493950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.494262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.494537 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.501560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.503040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.507044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.507660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.507939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.508212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.514787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:14.515211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:14.516171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:14.517047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:14.517471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.517545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 192/395] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:14.517545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.519380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:14.532315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:14.533730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 204/396] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:14.534599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.564735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.621818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70237bb-e76b-495a-8f3c-72360452dc59 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.637533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c844c9-50e3-4b28-b602-9497f68bbe78 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.656259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.656900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.657184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.657457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.667708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.669153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.674183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.674859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.675139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.675411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.676064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:14.676359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.677697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:14.683759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:14.684649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:14.685500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:14.685500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:14.685500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:14.685500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 193/397] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:14.686380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.692605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 205/398] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:14.693418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.751410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.779403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.786304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ad688-fcd9-4405-8fff-e240df363d9d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.794113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf09fd-31d8-4739-9b97-437e2daf0857 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.819249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.819867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.820150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.820419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.828295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.828978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.829574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.829710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.829854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.830154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.830848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:14.831159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.832586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:14.840700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:14.841662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:14.842594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 194/399] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:14.843179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.850644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 206/400] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:14.851459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:14.941200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25304460-be1b-4fa4-8709-e000aa4856b6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.949359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b014f-ca1a-48c2-91e7-ae87802774ee None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:14.968318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:14.975003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.975612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.975894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.976172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.976864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:14.977173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.978625 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.985386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:14.985977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:14.986287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:14.986565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:14.987229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:14.987531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:14.988882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:14.997126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 195/401] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:14.998811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.005184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 207/402] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:15.005184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.013981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:15.097352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a94fd-9a7d-4f9f-a994-e8c806589f42 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.099786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5470-36bf-47eb-81f9-2ec0279bbede None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.130424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.131033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.131310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.131581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.133172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.133766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.134043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.134367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.135090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:15.135394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.136836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.138529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.140047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:15.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:15.153368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:15.154327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 196/403] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:15.154887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 208/404] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Oct 23 19:53:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:15.154956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.155020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.189442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:15.231607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:15.255867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87f888-55aa-47d9-922e-dbe2d7cd4613 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.256571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180bbb7-3ced-43fc-89fa-011d77f5bb0a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.289390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.289776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.290028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.290338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.290432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.290611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/155cc268d5ef4e47bb7a16093a360ba7/roles/73eca01d2c8f437dac85693be9186f9b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.290709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.290971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/d8c8ca8a1b1a4cffaf64bc0840b5fd02/roles/73eca01d2c8f437dac85693be9186f9b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.304516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=155cc268d5ef4e47bb7a16093a360ba7, role_id=73eca01d2c8f437dac85693be9186f9b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.305246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=d8c8ca8a1b1a4cffaf64bc0840b5fd02, role_id=73eca01d2c8f437dac85693be9186f9b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.305955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.306841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.326410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 197/405] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:15 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/155cc268d5ef4e47bb7a16093a360ba7/roles/73eca01d2c8f437dac85693be9186f9b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:15.326410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.327277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 209/406] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:15 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/d8c8ca8a1b1a4cffaf64bc0840b5fd02/roles/73eca01d2c8f437dac85693be9186f9b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:15.327277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.436986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:15.456557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5ee9d-fc79-4a76-acd6-f59cacc419f5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.489143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4df4e-cb35-49c1-b230-6abb7b6c2ed7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.507780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.508418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.508709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.508988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.509966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:15.510357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.512216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.520870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:15.536303 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 210/407] 10.222.0.18 () {56 vars in 1139 bytes} [Sun Oct 23 19:53:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:15.536819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.536935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.537158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.537252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.537456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.539040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.541828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.570334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 198/408] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:53:15 2022] POST /identity/v3/users => generated 247 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:15.571228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.672665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7ca03-1ea9-4a7c-b157-d88cc6f30315 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.720411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.722051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.722559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.723406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.727034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30798340-b6b2-4625-93f7-52e79f1d6a35 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:15.738635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.740586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.748435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:15.779290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:15.780277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:15.781135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:15.781135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:15.781135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:15.787794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 211/409] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:15.790620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.812638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:15.815145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:15.816659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:15.817147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:15.837068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:15.839099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:15.857669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:15.858850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:15.859695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:15.859695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:15.859695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:15.862305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 199/410] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:15.868063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:15.904998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:15.963059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4bbff-4d2c-46f4-a7f8-783ad58a8740 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.011417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eecdb-740a-43b3-afb3-bf5d9ebfdf25 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.038823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.039434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.039710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.039977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.040630 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:16.040930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:16.042374 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:16.056300 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.056922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.057207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.057484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.058158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:16.058469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:16.059985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:16.066418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 212/411] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:16.072405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:16.080876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 200/412] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:16.087139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:16.214464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:16.238464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:16.253055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d4dd3-261b-4ed6-900c-de4a02927716 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.291316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b6f9-b163-486e-bd1a-5c806a1164cb None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.318372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.319007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.319290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.319562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.334333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:16.335784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:16.357227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:16.358163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:16.359215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 201/413] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:16.365018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:16.365599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.366280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.366562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.366836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.383502 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:16.385009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:16.398321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:16.399234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:16.400496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 213/414] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:16.410104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:16.536173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642ab9d-9391-4e40-8e1f-a94a063e4b57 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.583938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.584678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.584881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.585160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.585860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:16.586197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:16.587637 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:16.626502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 202/415] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:16.632255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:16.650193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:16.655919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8098c-648f-4166-94fa-b9d8265c22aa None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.692644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:16.740637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.741330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.741614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.741893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.743000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:16.743000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:16.744445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:16.759319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238259d5-e159-4a0f-92d3-c545f64d29f2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.776657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 214/416] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:16.796631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:16.807515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf416ff-e2a7-4593-b3c1-e5281bd322f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.807515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf416ff-e2a7-4593-b3c1-e5281bd322f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.807767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf416ff-e2a7-4593-b3c1-e5281bd322f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.808037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf416ff-e2a7-4593-b3c1-e5281bd322f7 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/3f748dc73ef7444d9382a0680e027c2d/roles/73eca01d2c8f437dac85693be9186f9b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.834374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf416ff-e2a7-4593-b3c1-e5281bd322f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=3f748dc73ef7444d9382a0680e027c2d, role_id=73eca01d2c8f437dac85693be9186f9b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:16.835770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf416ff-e2a7-4593-b3c1-e5281bd322f7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:16.869469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 203/417] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:16 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/3f748dc73ef7444d9382a0680e027c2d/roles/73eca01d2c8f437dac85693be9186f9b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:16.924278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0392-8fff-4637-bc43-188abfdbe9a2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:16.972377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5644c-9bc8-4daa-ba54-83ec940ac566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:16.973511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5644c-9bc8-4daa-ba54-83ec940ac566 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:16.974097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5644c-9bc8-4daa-ba54-83ec940ac566 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:16.974578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5644c-9bc8-4daa-ba54-83ec940ac566 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/201521dc87e544c0afcee0f7a7d0af7f/roles/73eca01d2c8f437dac85693be9186f9b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:16.999021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5644c-9bc8-4daa-ba54-83ec940ac566 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=201521dc87e544c0afcee0f7a7d0af7f, role_id=73eca01d2c8f437dac85693be9186f9b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:17.000489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5644c-9bc8-4daa-ba54-83ec940ac566 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:17.026101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 215/418] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:16 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/201521dc87e544c0afcee0f7a7d0af7f/roles/73eca01d2c8f437dac85693be9186f9b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:53:17.766632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8761-ccb4-4db8-9895-ee2380bf730b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:17.767146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8761-ccb4-4db8-9895-ee2380bf730b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:17.767146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8761-ccb4-4db8-9895-ee2380bf730b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:17.768842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 204/419] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:17.774725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658cbf-fe7d-4970-a5fc-2d831375d4a2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:17.775231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658cbf-fe7d-4970-a5fc-2d831375d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:17.775307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658cbf-fe7d-4970-a5fc-2d831375d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:17.805900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c9658cbf-fe7d-4970-a5fc-2d831375d4a2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:17.807109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c9658cbf-fe7d-4970-a5fc-2d831375d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:17.837538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:17.901733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 216/420] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:53:17.922131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba98bf-55f4-4664-bc90-00b256e30c97 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:17.922420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba98bf-55f4-4664-bc90-00b256e30c97 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:17.922702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba98bf-55f4-4664-bc90-00b256e30c97 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:17.924036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 205/421] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:17.941208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0591-7ff7-43d7-8d49-1653f2ff775b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:17.941496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0591-7ff7-43d7-8d49-1653f2ff775b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:17.941772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0591-7ff7-43d7-8d49-1653f2ff775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:17.965729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e0db0591-7ff7-43d7-8d49-1653f2ff775b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:17.967480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e0db0591-7ff7-43d7-8d49-1653f2ff775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:18.053175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 217/422] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:18.252071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba98bf-55f4-4664-bc90-00b256e30c97 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:18.273364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea296c5-4617-4336-86a2-cf8070b5fe8c None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:18.273672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea296c5-4617-4336-86a2-cf8070b5fe8c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:18.273921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea296c5-4617-4336-86a2-cf8070b5fe8c None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:18.275549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 218/423] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:18.281763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ff1b-e154-4b52-bb25-d3b979ac3d2a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:18.282044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ff1b-e154-4b52-bb25-d3b979ac3d2a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:18.282339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7ff1b-e154-4b52-bb25-d3b979ac3d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:18.319366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9bc7ff1b-e154-4b52-bb25-d3b979ac3d2a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:18.320545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9bc7ff1b-e154-4b52-bb25-d3b979ac3d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:18.358432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:18.417168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba98bf-55f4-4664-bc90-00b256e30c97 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:18.439955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 219/424] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:18.440808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7ff1b-e154-4b52-bb25-d3b979ac3d2a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:18.479910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:18.481501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:18.482910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:18.483132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:18.483474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:18.503178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:18.514955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:18.515856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:18.516645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:18.517236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 206/425] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:18.523071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:18.641939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7ff1b-e154-4b52-bb25-d3b979ac3d2a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:18.709035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:18.709667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:18.709948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:18.710250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:18.726390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9e8f6-e15a-4847-a548-bff4805994b0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:18.733138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:18.742989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:18.743900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:18.744685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 220/426] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:18.755401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:18.775872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:18.788953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:18.789820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:18.790311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:18.790756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:18.791700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:18.792271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:18.793816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:18.807699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 207/427] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:18.807699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:18.849868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:18.883753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327b15c-4534-46b6-be07-1fb44b3a8b1a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:18.922263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae20b1-a68f-43e5-85d3-93d2a00d5631 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:18.929518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:18.930403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:18.930879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:18.931837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:18.933218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:18.933993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:18.936155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:18.953112 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 221/428] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:18.954717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:18.963045 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:18.963659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:18.963942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:18.964217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:18.975338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:18.981523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:18.982939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:18.983740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:18.988106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 208/429] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:18.988949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.044569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:19.099075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643973d0-c5c3-4921-abaa-59e9a02e4ef7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.112960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7058d9-569f-4d88-807b-40c03b5b405f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.146727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.147356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.147633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.147904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.156263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:19.158109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.158968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.159568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.160040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.160814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.162590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.174201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.175951 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:19.177999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:19.178884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:19.179725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:19.179725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:19.179725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:19.179725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 222/430] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:19.180364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:19.195400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:19.196324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:19.197187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:19.197187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:19.197187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:19.204373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 209/431] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:19.204373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.294190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4026eb-ea2f-48be-b768-925ef9a13f96 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.318004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:19.326416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667d853-36bb-4c93-bae3-b908e53fb166 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.332589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.333473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.333976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.334482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.335878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:19.336387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.338924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.355668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 223/432] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:19.355668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.369388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.369995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.370319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.370594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.371270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:19.372063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.374472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.388929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 210/433] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:19.389818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.428862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:19.503355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383a943-be3d-49f2-aec3-2e55788f3aee None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.514775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fb2e1-d6e6-4bd7-a247-0cf2d656d7d7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.550316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.551603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.552124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.552631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.553703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:19.554310 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.554947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.555691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.556041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.556424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.556891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.568694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.570506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.579179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 224/434] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:19.580537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:19.591464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:19.592503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:19.593339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:19.593339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:19.593339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:19.593339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 211/435] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:19.594072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.613795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:19.695413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ecfc-cf40-44e1-a327-41e1b14fa2f1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.708446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:19.711025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d2b9c-acfc-4894-b8de-559869d0553d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.729480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85ff8c-bbda-4e51-9bbd-d906c852f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.730120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85ff8c-bbda-4e51-9bbd-d906c852f0ed None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.730403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85ff8c-bbda-4e51-9bbd-d906c852f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.730675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85ff8c-bbda-4e51-9bbd-d906c852f0ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.738009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85ff8c-bbda-4e51-9bbd-d906c852f0ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.739461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85ff8c-bbda-4e51-9bbd-d906c852f0ed None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.744259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dadd5-7e6a-4a3b-995c-52e867a51739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.744876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dadd5-7e6a-4a3b-995c-52e867a51739 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.745158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dadd5-7e6a-4a3b-995c-52e867a51739 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.745441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dadd5-7e6a-4a3b-995c-52e867a51739 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8e85ff8c-bbda-4e51-9bbd-d906c852f0ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:19.751583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:19.752574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 225/436] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fc44-0df7-456f-bbd1-32ce75002282 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.754373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fc44-0df7-456f-bbd1-32ce75002282 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.755076 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fc44-0df7-456f-bbd1-32ce75002282 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.755143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dadd5-7e6a-4a3b-995c-52e867a51739 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.755861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 226/437] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:19.756070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dadd5-7e6a-4a3b-995c-52e867a51739 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.759100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241fc44-0df7-456f-bbd1-32ce75002282 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e97dadd5-7e6a-4a3b-995c-52e867a51739 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:19.769187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:19.770123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:19.771031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 212/438] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:19.772406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f9c73-8250-42cc-9a27-7d67828ed2e9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.772721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f9c73-8250-42cc-9a27-7d67828ed2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.772956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f9c73-8250-42cc-9a27-7d67828ed2e9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.774464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 213/439] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:19.775158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f9c73-8250-42cc-9a27-7d67828ed2e9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.844403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:19.864812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241fc44-0df7-456f-bbd1-32ce75002282 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.878814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f9c73-8250-42cc-9a27-7d67828ed2e9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:19.898859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adad87a-9ca6-450d-a3d5-67338715c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.899459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adad87a-9ca6-450d-a3d5-67338715c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.899742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adad87a-9ca6-450d-a3d5-67338715c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.900016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adad87a-9ca6-450d-a3d5-67338715c9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.900651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adad87a-9ca6-450d-a3d5-67338715c9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:19.900955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adad87a-9ca6-450d-a3d5-67338715c9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.902371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adad87a-9ca6-450d-a3d5-67338715c9a9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.912528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:19.913124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.913404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.913678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.913927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 227/440] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:19.918525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:19.918525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:19.918658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf3e6-a5cc-43b8-aad7-f3b30f6684f5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:19.918658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf3e6-a5cc-43b8-aad7-f3b30f6684f5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:19.918658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf3e6-a5cc-43b8-aad7-f3b30f6684f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:19.918850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:19.932911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7fbbf3e6-a5cc-43b8-aad7-f3b30f6684f5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:19.934116 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7fbbf3e6-a5cc-43b8-aad7-f3b30f6684f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:19.935654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 214/441] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:19.936765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:19.961226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.002629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 228/442] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:20.003929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094c5c-1e0a-44a8-a503-f594a8820c28 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.004226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094c5c-1e0a-44a8-a503-f594a8820c28 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.004501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094c5c-1e0a-44a8-a503-f594a8820c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.025172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-27094c5c-1e0a-44a8-a503-f594a8820c28 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:20.026891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-27094c5c-1e0a-44a8-a503-f594a8820c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:20.035352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb166-0da2-44a2-a5e1-4c03ce86840a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.065380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.075805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.076863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.077153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.077425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.078530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:20.078820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:20.080304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:20.110177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 229/443] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:20.110177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094c5c-1e0a-44a8-a503-f594a8820c28 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.110412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 215/444] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Oct 23 19:53:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:20.110412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.210932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.225353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094c5c-1e0a-44a8-a503-f594a8820c28 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.226719 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173d0df-305a-417a-80bf-934a9d47da3e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.265913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.266677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.267021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.267361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.271925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.272562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.272844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.273123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.281789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:20.283277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:20.295328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:20.296298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 230/445] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:20.297176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.327944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.345061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:20.346566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:20.398016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b11c-cc7e-4151-ad94-432fd195a0f5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.432020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.432641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.432921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.433189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.448627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 216/446] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:20.449762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.455227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.502970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:20.504417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:20.532805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.550030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60178410-b056-4697-b66a-9986ec7de846 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.584830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.585448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.585731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.586005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.595810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:20.600635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:20.601492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:20.602328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 217/447] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:20.602987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.607940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 231/448] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:20.608847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.660504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.706697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dd367-aaff-4f70-bfe0-631c2596e74b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.707698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f1139-b049-4f61-b36c-a2c4be28c8a3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.740751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.740932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.741378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.741493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.741654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.741751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.741926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.742011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.742677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:20.742983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:20.744395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:20.752171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:20.756859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:20.757761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 232/449] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:20.759583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.766455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 218/450] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:20.767266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.770358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.855769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66e8f-6bb8-4036-a8ab-4044ad835fc4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.865053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e2f66-0867-4c9e-9c62-094a18f47025 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:20.868469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:20.890183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.890796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.891068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.891341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.898444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:20.899036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:20.899316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:20.899587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:20.900242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:20.900566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:20.900817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:20.901910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:20.902278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:20.909689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 219/451] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:20.910560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:20.920959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:20.921914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:20.922915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:20.922915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:20.922915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:20.922915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 233/452] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:20.922915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:20.973942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.011604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e0e9d-ae29-41dd-a023-b3f4e60e89b8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.020829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189ff5-a0ba-45ff-ad5a-067ae6c07c5b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.045665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.046309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.046590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.046870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.054037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.054651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.054930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.055206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.055862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:21.056158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.057024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.057613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.058466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.065627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 234/453] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:21.066443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:21.073864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:21.075003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:21.076361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:21.076361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.076361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:21.076361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 220/454] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:21.076802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.095402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.167882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eed26c-3ca8-46d8-8ab8-d7a0ffd2c703 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.174549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d7aea-fd74-4cb3-9288-59085c8a6a18 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.190012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.202034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.202674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.202957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.203223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.208142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.208754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.209035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.209307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.213900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.215383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.219563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.220961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:21.229467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:21.230421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:21.231274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:21.231274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.231274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:21.231436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 235/455] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:21.232777 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:21.235266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:21.236248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:21.237268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:21.237268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.237268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:21.237268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 221/456] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:21.237268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.315754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.334697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe332a08-96fd-4ba9-84ec-c7d0f1c4d3c7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.337451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0e7a-eb37-4c40-8a2c-670e9f9a5f11 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.367623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.368233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.368514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.368784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.370783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.371368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.371642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.371912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.372600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:21.372979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.374271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.379264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.380681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.385960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 236/457] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:21.387019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:21.395580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:21.396612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:21.397648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:21.397648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:21.397648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:21.398210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 222/458] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:21.399140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.420705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.487327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1648d0-bc66-48a0-8b28-530e49eed4bc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.498742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc73d05-73df-4891-bf9f-542d2e96da6f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.522041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.522658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.522933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.523202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.523830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:21.524132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.525481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.532138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.532874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.533475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.533783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.534051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.534818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:21.535124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.536480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.537906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 237/459] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:21.538737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.551993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 223/460] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:21.557294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.639784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.639964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4822b-14a6-4363-93f4-75c98d167665 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.659319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2bcb4-0a45-437c-93fb-542d97729fab None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.672950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.673502 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.673780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.674052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.674730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:21.675031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.676398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.688705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 238/461] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:21.689491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.696155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.696772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.697047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.697316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.705150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.706605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:21.718190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:21.719067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:21.719895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 224/462] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:21.720341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.755175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.798221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7444dd-f342-4b8d-bd9a-61d13ffc062d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.820182 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd031b07-12e6-4642-b0ff-2fc9865d7141 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.832540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.833134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.833415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.833684 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.834385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:21.834743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.836133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.847050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 239/463] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:21.847996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.860213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.860829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.861105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.861375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.867985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.869398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:21.871896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:21.882052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:21.883058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 225/464] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:21.883937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:21.951412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980252a-b19d-46ab-a77c-0a2ac3b55ea1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.969261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:21.984020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9bfa0-7af0-47e8-add6-81540cba346c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:21.986322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:21.986942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:21.987220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:21.987489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:21.993904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:21.995373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:22.006431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:22.007285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:22.008149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 240/465] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:22.008613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.021339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.021963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.022274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.022552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.029918 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.031390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:22.042458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:22.043325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:22.044728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 226/466] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:22.045368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.101480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:22.112753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d3260-60f2-483d-ab98-15b48a75718a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.142155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd01bb2-544e-414e-853c-219be317c1bd None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.146371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.146968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.147248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.147521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.148209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:22.148517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.149933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.161669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 241/467] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:22.162486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.175747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.176534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.176815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.177088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.184332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.187114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:22.197808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:22.198885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:22.199774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 227/468] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:22.200327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.201658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:22.269651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8c5d-8a97-4739-b618-f1a04660eb1f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.303675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.304273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.304553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.304824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.305503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:22.305807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.306267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38578f4-38f8-4fb3-a8b0-69dfd779885a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.307262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.319483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 242/469] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:22.320434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.331088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:22.346181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.346773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.347058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.347332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.348021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:22.348327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.349742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.361327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 228/470] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:22.362388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.416016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:22.419491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd01a6-e3c5-4db6-8840-d1db567dac15 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.454532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.455057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.455339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.455613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.456335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:22.456643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.458056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.461291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0a686-e50d-4a98-a53d-818a772211ba None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.475535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 243/471] 10.222.0.18 () {56 vars in 1139 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:22.476326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.494995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.495599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.495882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.496156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.496873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] RBAC: Adding query filter params (role.id=73eca01d2c8f437dac85693be9186f9b, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=155cc268d5ef4e47bb7a16093a360ba7) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:22.497185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.499230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.504892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 229/472] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/role_assignments?user.id=155cc268d5ef4e47bb7a16093a360ba7&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=73eca01d2c8f437dac85693be9186f9b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:22.505674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.556404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:22.592151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e02e1b-1234-4a84-88c4-a756bde24769 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.630358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c61de-8eef-4f79-951a-271738304db1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.636267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.637044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.637421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.637811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.639007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:22.639122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.640748 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.661631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 244/473] 10.222.0.18 () {56 vars in 1137 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:22.662531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.669054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.670270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.670556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.670825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.671563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] RBAC: Adding query filter params (role.id=73eca01d2c8f437dac85693be9186f9b, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=d8c8ca8a1b1a4cffaf64bc0840b5fd02) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:22.671874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.673342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.680293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 230/474] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/role_assignments?user.id=d8c8ca8a1b1a4cffaf64bc0840b5fd02&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=73eca01d2c8f437dac85693be9186f9b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:22.680885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.681556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:22.800446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56cb28-9afa-4ead-b7ba-ccc6559e0453 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.817120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08368e-e4c1-4c95-b430-cba367e625af None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:22.840926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:22.851364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.852425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.852909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.853381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/5ddd37ebc3874a8f8a8d60c0a32bf090/roles/73eca01d2c8f437dac85693be9186f9b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.855210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:22.856032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:22.856440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:22.857480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:22.877347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=5ddd37ebc3874a8f8a8d60c0a32bf090, role_id=73eca01d2c8f437dac85693be9186f9b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.878849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.896910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 245/475] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:22 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/5ddd37ebc3874a8f8a8d60c0a32bf090/roles/73eca01d2c8f437dac85693be9186f9b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:22.898834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:22.950285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:22.952388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:22.992318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:23.055055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e13dc-0333-4807-b074-0d5cec7f7aa9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:23.090348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 231/476] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:23.092129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:23.106205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:23.106836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:23.107314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:23.107605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:23.108283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:23.187828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:23.189284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:23.217901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841a19-eeb7-431b-8d78-311a84f0ba88 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:23.254885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:23.262922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:23.264290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:23.264747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:23.265028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:23.279222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:23.280664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:23.298022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:23.298975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:23.299811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:23.299811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:23.299811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:23.299811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 232/477] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:23.305474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:23.317474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 246/478] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:23.323120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:23.423827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:23.496948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd5601-e1ca-44a4-8930-99068adeb134 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:23.517487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbcd8a-294a-4ed3-809c-59e455e8ed63 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:23.571873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:23.572473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:23.572676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:23.572962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:23.573614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:23.573920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:23.575307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:23.577491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:23.578122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:23.578390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:23.578658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:23.590528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:23.592287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:23.599074 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 233/479] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:23.604588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:23.612571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:23.613615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:23.614543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:23.614543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:23.614543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:23.614543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 247/480] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:23.620811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:23.642592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:23.748383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca02c5-9b21-42cf-a051-a47f9fc0bce7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:23.788952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:23.789554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:23.789849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:23.790207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:23.790855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:23.791670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:23.793046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:23.807180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 248/481] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:23.814202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:23.864183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244730a-bd03-46c9-944f-f8aee539fde2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:23.906338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:23.907479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:23.936147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:23.937807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:23.938105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:23.938417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:23.946049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059459bb-9f46-4436-b4c5-e7aedfefbc3f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:23.954327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:23.958349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:23.974224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:23.975081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:23.976006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:23.976415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 234/482] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:23.983636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:24.016856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:24.017508 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:24.017754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:24.018022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:24.026818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:24.028262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:24.051938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:24.052847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:24.053682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:24.056214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 249/483] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:24.062108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:24.193411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0c72-1ce3-4f13-8fb4-bbdc72f5dd21 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:24.247077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbae0c-b0b9-4650-b87b-4603118cb3a5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:24.273372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:24.273997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:24.274301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:24.274567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:24.275265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:24.278169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:24.280805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:24.299857 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:24.300462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:24.300739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:24.301010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:24.301711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:24.302016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:24.304350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:24.304460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 235/484] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:24.306239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:24.310488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:24.317588 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 250/485] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:24.326115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:24.394522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:24.502581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aef76-6fbd-4b11-8795-fb04822bba25 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:24.505984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2de3b5-6354-4241-b984-8be850aa67d6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:24.546946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87bb1b-069c-4da7-96e9-5421b76711cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:24.547562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87bb1b-069c-4da7-96e9-5421b76711cd None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:24.547842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87bb1b-069c-4da7-96e9-5421b76711cd None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:24.548116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87bb1b-069c-4da7-96e9-5421b76711cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:24.548845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87bb1b-069c-4da7-96e9-5421b76711cd None admin] RBAC: Adding query filter params (role.id=73eca01d2c8f437dac85693be9186f9b, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=3f748dc73ef7444d9382a0680e027c2d) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:24.549156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87bb1b-069c-4da7-96e9-5421b76711cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:24.550619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87bb1b-069c-4da7-96e9-5421b76711cd None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:24.552816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d29ef-efcd-45c4-9c6d-6c19162628f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:24.553414 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d29ef-efcd-45c4-9c6d-6c19162628f3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:24.553691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d29ef-efcd-45c4-9c6d-6c19162628f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:24.553962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d29ef-efcd-45c4-9c6d-6c19162628f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:24.554719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d29ef-efcd-45c4-9c6d-6c19162628f3 None admin] RBAC: Adding query filter params (role.id=73eca01d2c8f437dac85693be9186f9b, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=201521dc87e544c0afcee0f7a7d0af7f) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:24.555024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d29ef-efcd-45c4-9c6d-6c19162628f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:24.556432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d29ef-efcd-45c4-9c6d-6c19162628f3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:24.563920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 236/487] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:24 2022] GET /identity/v3/role_assignments?user.id=3f748dc73ef7444d9382a0680e027c2d&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=73eca01d2c8f437dac85693be9186f9b => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:24.564091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 251/487] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:24 2022] GET /identity/v3/role_assignments?user.id=201521dc87e544c0afcee0f7a7d0af7f&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=73eca01d2c8f437dac85693be9186f9b => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:25.052876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf7bc-8cf2-4b9e-8a54-23a83b89d366 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:25.053485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf7bc-8cf2-4b9e-8a54-23a83b89d366 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:25.053485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf7bc-8cf2-4b9e-8a54-23a83b89d366 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:25.055046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 252/488] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:25.060603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bcbe2-2013-482f-801c-6a0f17674441 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:25.061479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bcbe2-2013-482f-801c-6a0f17674441 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:25.062249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bcbe2-2013-482f-801c-6a0f17674441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:25.085124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ab9bcbe2-2013-482f-801c-6a0f17674441 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:25.086735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ab9bcbe2-2013-482f-801c-6a0f17674441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:25.179230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 237/489] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:25.463181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511c05a-2069-4f35-b245-dc4e7afdafd3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:25.463464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511c05a-2069-4f35-b245-dc4e7afdafd3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:25.463742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511c05a-2069-4f35-b245-dc4e7afdafd3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:25.465339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 253/490] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:25.471466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a5ad-1dc1-4ca6-ba75-b6cbcb82c1f8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:25.471869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a5ad-1dc1-4ca6-ba75-b6cbcb82c1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:25.472246 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a5ad-1dc1-4ca6-ba75-b6cbcb82c1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:25.493492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-aff8a5ad-1dc1-4ca6-ba75-b6cbcb82c1f8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:25.494706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-aff8a5ad-1dc1-4ca6-ba75-b6cbcb82c1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:25.499240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a85fe-ca7c-4c4d-a251-16b2cadb63ec None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:25.499531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a85fe-ca7c-4c4d-a251-16b2cadb63ec None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:25.499972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a85fe-ca7c-4c4d-a251-16b2cadb63ec None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:25.501569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 254/491] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:25.507752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7277fed-6fbd-4b42-bd7d-bc6c541b70da None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:25.508049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7277fed-6fbd-4b42-bd7d-bc6c541b70da None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:25.508318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7277fed-6fbd-4b42-bd7d-bc6c541b70da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:25.525355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:25.534170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d7277fed-6fbd-4b42-bd7d-bc6c541b70da None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:25.535719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d7277fed-6fbd-4b42-bd7d-bc6c541b70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:25.573199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 238/492] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:25.581563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a5ad-1dc1-4ca6-ba75-b6cbcb82c1f8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:25.601462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:25.632533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 255/493] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:25.753822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a5ad-1dc1-4ca6-ba75-b6cbcb82c1f8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:25.796578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:25.797212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:25.797511 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:25.797788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:25.814499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:25.819447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:25.820301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:25.821085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 239/494] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:25.826409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7277fed-6fbd-4b42-bd7d-bc6c541b70da None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:25.913163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:25.944017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:25.988467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7277fed-6fbd-4b42-bd7d-bc6c541b70da None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.024548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.025075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.025402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.025682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.026380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:26.026685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.027040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5a59a-bd13-4020-8004-160f71e39fb5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.028056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.037319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 256/495] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:26.038770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.064711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.065979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.066476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.066762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.079073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:26.083933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:26.085347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 240/496] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:26.086337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.111202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.166089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e6c3-b222-4868-b245-39e6d2fb7d23 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.180495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.198242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295dbac-278e-4b98-afd2-c4ec277cb6b3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.205978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.207019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.207499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.207984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.220676 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.222431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.235027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.235657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.235943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.236394 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:26.238899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:26.239788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:26.240904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:26.240904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:26.240904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:26.242801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 257/497] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:26.244079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.248880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.250457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:26.266326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:26.267301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:26.268167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:26.268167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:26.268167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:26.268167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 241/498] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:26.268393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.369440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43dae7-3419-439c-8e64-7a413326207f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.372490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.374929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d378a-1cbc-4618-b3d5-a959820905c4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.409551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.410573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.411054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.411396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.411747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.412003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.412278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.412553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.413191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:26.413451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:26.413561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.414041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.414866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.415787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.417218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.432001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 242/500] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:26.432001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.432530 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 258/500] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:26.433665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.532917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300771e-2042-4cd6-9d68-38e5031aff69 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.543272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0b33-39f1-4883-bf57-f65663e294ba None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.568108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.568681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.568967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.569241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.569991 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:26.570209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.571562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.582810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.583688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.584191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.584663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.584767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 243/501] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:26.585510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.597361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.599767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:26.619040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:26.620051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:26.621409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:26.621409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:26.621409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:26.623666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 259/502] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:26.629171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.644648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.653219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.691616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66995fbe-ac79-4dea-9283-261b36ed03b2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.726690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.727264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.727556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.727830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.728566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.730033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.749075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a398f-672e-4114-9534-79fd119f8261 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.756105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 244/503] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:53:26 2022] POST /identity/v3/users => generated 254 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:26.757096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.790332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54378e29-436e-45df-bc54-47491f75efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.791442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54378e29-436e-45df-bc54-47491f75efce None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.791934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54378e29-436e-45df-bc54-47491f75efce None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.792408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54378e29-436e-45df-bc54-47491f75efce None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.801978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54378e29-436e-45df-bc54-47491f75efce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:26.803931 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54378e29-436e-45df-bc54-47491f75efce None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-54378e29-436e-45df-bc54-47491f75efce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:26.817691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:26.818752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:26.819754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:26.822574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 260/504] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:26.830960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54378e29-436e-45df-bc54-47491f75efce None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:26.916437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20e3b6-f429-4e89-a736-2ee8bb204ca2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:26.944064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.969605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:26.993033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:26.994029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:26.995265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:26.995730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:26.999969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:27.000537 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.002570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.025132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54378e29-436e-45df-bc54-47491f75efce None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:27.030489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 245/505] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:27.036318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:27.077668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:27.078569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.078858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.079133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.079873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:27.080184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.081822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.104462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 261/506] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Oct 23 19:53:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:27.110623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:27.170601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7fe6-e49e-4c53-aab1-6b4f217ba09f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:27.217127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:27.218737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.219245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.220264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.239698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.245105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:27.268002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:27.269005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:27.269919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:27.270508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 246/507] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:27.277010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:27.284900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdcc5a-d484-4668-af80-975ac95a001e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:27.323091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:27.343884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cc617-cb0a-4d31-8a44-caf7e53596fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:27.345004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cc617-cb0a-4d31-8a44-caf7e53596fa None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.345296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cc617-cb0a-4d31-8a44-caf7e53596fa None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.345568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cc617-cb0a-4d31-8a44-caf7e53596fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.349244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:27.360825 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cc617-cb0a-4d31-8a44-caf7e53596fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.362883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cc617-cb0a-4d31-8a44-caf7e53596fa None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e45cc617-cb0a-4d31-8a44-caf7e53596fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:27.381522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:27.382572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:27.383462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:27.383462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:27.383462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:27.383462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 262/508] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:27.384632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998293b-974f-487c-ae05-87114d1a9137 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.384918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998293b-974f-487c-ae05-87114d1a9137 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.385189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998293b-974f-487c-ae05-87114d1a9137 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.389827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 263/509] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:27.390980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee700b-c002-43f4-a311-09893fd155c2 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.391265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee700b-c002-43f4-a311-09893fd155c2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.391542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee700b-c002-43f4-a311-09893fd155c2 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.392844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 264/510] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:27.395386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee700b-c002-43f4-a311-09893fd155c2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:27.416133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c57b-2d24-4a8a-a226-d7901947dd33 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:27.457168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee76d6-48b8-4de7-88ef-d11b4d13f392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:27.457695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee76d6-48b8-4de7-88ef-d11b4d13f392 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.457977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee76d6-48b8-4de7-88ef-d11b4d13f392 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.458285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee76d6-48b8-4de7-88ef-d11b4d13f392 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.459010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee76d6-48b8-4de7-88ef-d11b4d13f392 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:27.459319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee76d6-48b8-4de7-88ef-d11b4d13f392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.460842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee76d6-48b8-4de7-88ef-d11b4d13f392 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.480244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 247/511] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Oct 23 19:53:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:27.484077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a86d-4d66-41f4-9117-b85f9232f785 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.485017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a86d-4d66-41f4-9117-b85f9232f785 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.485359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a86d-4d66-41f4-9117-b85f9232f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.504963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-16f9a86d-4d66-41f4-9117-b85f9232f785 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:27.506190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-16f9a86d-4d66-41f4-9117-b85f9232f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:27.508198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee700b-c002-43f4-a311-09893fd155c2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:27.544568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286341-bec5-40e5-8f02-423bd4f8b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:27.545184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286341-bec5-40e5-8f02-423bd4f8b382 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.545466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286341-bec5-40e5-8f02-423bd4f8b382 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.545743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286341-bec5-40e5-8f02-423bd4f8b382 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.546423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286341-bec5-40e5-8f02-423bd4f8b382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:27.546849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286341-bec5-40e5-8f02-423bd4f8b382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.548217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286341-bec5-40e5-8f02-423bd4f8b382 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.561861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 265/512] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:27.567524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc837106-d8e1-4a11-8cfb-90456d18930f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.567811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc837106-d8e1-4a11-8cfb-90456d18930f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.568093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc837106-d8e1-4a11-8cfb-90456d18930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.574349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 248/513] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:27.575539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9a86d-4d66-41f4-9117-b85f9232f785 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:27.595932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fc837106-d8e1-4a11-8cfb-90456d18930f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:27.597504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fc837106-d8e1-4a11-8cfb-90456d18930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:27.604460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:27.653233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:27.694238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 266/514] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:27.696275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc837106-d8e1-4a11-8cfb-90456d18930f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:27.712438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9a86d-4d66-41f4-9117-b85f9232f785 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:27.783548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:27.784161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.784442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.784714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.852072 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc837106-d8e1-4a11-8cfb-90456d18930f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:27.887517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:27.888794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:27.889077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:27.889348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:27.893546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.896208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:27.897646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.904180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:27.909598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:27.910557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:27.911642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:27.912241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 267/515] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:27.919888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:27.932850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:27.964059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:28.024071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 249/516] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 19:53:28.025218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.029828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba85ac-da8a-495b-a5da-c302473a1e85 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.066917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.067549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.067827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.068096 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] PATH_INFO: `/v3/services/network` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.068676 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.070033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:28.081487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:28.082552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:28.083466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:28.087423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 268/517] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:27 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:28.088201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.129822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f35c0-7dae-4a04-9143-08a7eb656118 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.149890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:28.165798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.166429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.166708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.166978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.167665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:28.167972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.169439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.186230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 250/518] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:28.186230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.199841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372ebd5-4dd3-4643-ad79-186c70f04f7e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.201440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:28.236899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.237457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.237741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.238023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.253980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.255743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:28.270693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:28.271652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:28.272519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:28.272519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:28.272519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:28.272519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 269/519] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:28.273174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.297801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172f193-835f-4ffd-bd56-016cb567d3ca None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.336492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.337125 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.337407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.337684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.338304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.339662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:28.351130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:28.352308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:28.353295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:28.358117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 251/520] 10.222.0.18 () {56 vars in 1129 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:28.358257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.392169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30837d7-faee-498f-8a56-e2874ee94dcd None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.422516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:28.428483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.429089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.429372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.429647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.430298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] RBAC: Adding query filter params (name=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:28.431035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.432409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.442368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 270/521] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:28.442368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.458467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:28.487541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2b9cd-a38d-4cea-b474-f3749307bd02 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.526876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.527524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.527804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.528079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/155cc268d5ef4e47bb7a16093a360ba7/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.530776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=155cc268d5ef4e47bb7a16093a360ba7, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.532193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.558110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 252/522] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:28 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/155cc268d5ef4e47bb7a16093a360ba7/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:28.558327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429683-d6a2-4d77-bf68-972c4a737810 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.558464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.590107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.590760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.591058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.591334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.591957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:28.592257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.593663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.620635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 271/523] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:28.622013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.703282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed44fb-e60b-438a-b0e2-ed7c2a16a8b9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.707753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:28.742168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:28.753430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.753851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.754208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.754543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.755181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:28.755490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.756857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.761665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 253/524] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:28.765283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.775647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437440-8939-4b61-aabf-1eb364474a1e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.820252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.820960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.821313 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.821661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.822905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] RBAC: Adding query filter params (type=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:28.823339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:28.825140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:28.833011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 272/525] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:28.833743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:28.920002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79a2e-f79f-4f32-a5dd-580ffda019b8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:28.980592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:28.981231 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:28.981538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:28.981863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:28.999341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:29.000730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:29.018956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:29.019919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:29.020880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 254/526] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:29.026010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:29.041794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84600606-3105-4b7c-8a6b-8acc5d539997 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:29.066567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:29.096547 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:29.097791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:29.098737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:29.099273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:29.100113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:29.100613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:29.102853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:29.110487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 273/527] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Oct 23 19:53:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:29.184555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e0332-a1f9-41c8-9bf5-b27dfd23a247 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:29.241061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9c84-3f32-4c31-9399-e213040c8470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:29.241829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9c84-3f32-4c31-9399-e213040c8470 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:29.242144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9c84-3f32-4c31-9399-e213040c8470 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:29.242426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9c84-3f32-4c31-9399-e213040c8470 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:29.243132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9c84-3f32-4c31-9399-e213040c8470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:29.243473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9c84-3f32-4c31-9399-e213040c8470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:29.245096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9c84-3f32-4c31-9399-e213040c8470 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:29.259836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 255/528] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:29.265613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:29.282858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f55d-4d4e-43f5-88fb-439c4f3239c5 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:29.283187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f55d-4d4e-43f5-88fb-439c4f3239c5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:29.283480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531f55d-4d4e-43f5-88fb-439c4f3239c5 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:29.284475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:29.285989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 256/529] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:53:29.291581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c76d-0a0d-48b0-86a8-03f316c92cde None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:29.291870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c76d-0a0d-48b0-86a8-03f316c92cde None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:29.292150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c76d-0a0d-48b0-86a8-03f316c92cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:29.317091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b3f3c76d-0a0d-48b0-86a8-03f316c92cde None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:29.318558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b3f3c76d-0a0d-48b0-86a8-03f316c92cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:29.442301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 257/530] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 23 19:53:29.466358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c06056-3211-4b61-a723-af097cfe6a30 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:29.508692 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:29.509298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:29.509578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:29.509906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:29.510626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] RBAC: Adding query filter params (role.id=73eca01d2c8f437dac85693be9186f9b, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=5ddd37ebc3874a8f8a8d60c0a32bf090) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:29.510936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:29.512374 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:29.521731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 274/531] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:29 2022] GET /identity/v3/role_assignments?user.id=5ddd37ebc3874a8f8a8d60c0a32bf090&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=73eca01d2c8f437dac85693be9186f9b => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:29.843117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c76d-0a0d-48b0-86a8-03f316c92cde None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:29.862726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:29.956726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c76d-0a0d-48b0-86a8-03f316c92cde None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:29.996455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:29.997601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:29.997896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:29.998203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:30.010259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:30.015242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:30.016150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:30.016986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 258/532] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:30.025200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:30.159445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:30.207636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d07e24-a63b-41ac-9bda-e39b89d95851 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:30.259860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:30.260427 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:30.260711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:30.260985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:30.261658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:30.261964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:30.263919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:30.278161 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 275/533] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:30.286682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:30.397601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:30.423578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb02c6-5e5f-49a0-a3a8-4e391ada9e14 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:30.471673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:30.472654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:30.473141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:30.473635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:30.487057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:30.488855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:30.508085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:30.509053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:30.509931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:30.509931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:30.509931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:30.511678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 259/534] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:30.520054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:30.718610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca43a0-f56e-4c70-9c38-3f7fa6a8a50b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:30.768251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:30.782982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:30.783947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:30.784420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:30.784877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:30.785939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:30.786476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:30.788936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:30.813755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 276/535] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:30.821595 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:31.040091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e351b7-68c5-4f4a-94b4-2c297e3f2caa None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:31.090389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:31.099456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:31.100492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.100974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.101441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.115481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:31.118100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:31.140249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:31.142114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:31.144699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 260/536] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:53:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:31.150926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:31.307347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75a651-5213-433d-b861-944cd33960a0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:31.358400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782e3c-cde8-476f-9dea-89bfc0b69ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:31.359104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782e3c-cde8-476f-9dea-89bfc0b69ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.359378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782e3c-cde8-476f-9dea-89bfc0b69ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.359650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782e3c-cde8-476f-9dea-89bfc0b69ab0 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.360408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782e3c-cde8-476f-9dea-89bfc0b69ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:31.360717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782e3c-cde8-476f-9dea-89bfc0b69ab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:31.362227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782e3c-cde8-476f-9dea-89bfc0b69ab0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:31.392730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 277/537] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Oct 23 19:53:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:31.400828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:31.583866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630aef-05be-4c48-93d7-7824215cb4f6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:31.613667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2dc9-84b3-4f86-93d2-4cb437f2bad6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.614400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2dc9-84b3-4f86-93d2-4cb437f2bad6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.622326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2dc9-84b3-4f86-93d2-4cb437f2bad6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.629685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 278/538] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:31.631055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734bf5-2e7a-4311-bf45-0aaaf35d637e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.631341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734bf5-2e7a-4311-bf45-0aaaf35d637e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.631625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734bf5-2e7a-4311-bf45-0aaaf35d637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.649384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:31.650731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.651535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.652203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.673249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:31.676466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:31.687546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f7734bf5-2e7a-4311-bf45-0aaaf35d637e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:31.688790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f7734bf5-2e7a-4311-bf45-0aaaf35d637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:31.709780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:31.711931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:31.713947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:31.713947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:31.713947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:31.722125 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 261/539] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:31.727882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:31.798136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:31.810519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:31.839400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 279/540] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:31.840558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882fc1e-5d5c-41e1-869f-60daec1816bd None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.840886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882fc1e-5d5c-41e1-869f-60daec1816bd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.841228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882fc1e-5d5c-41e1-869f-60daec1816bd None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.842493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 280/541] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:31.848108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e374b3-30bc-42d2-8bb6-3aaa133a8363 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.848402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e374b3-30bc-42d2-8bb6-3aaa133a8363 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.848681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e374b3-30bc-42d2-8bb6-3aaa133a8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.868157 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d0e374b3-30bc-42d2-8bb6-3aaa133a8363 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:31.869507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d0e374b3-30bc-42d2-8bb6-3aaa133a8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:31.883191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed2991-6e4c-447c-9f7d-3764ead7ec06 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:31.935203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:31.935822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:31.937765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:31.938429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:31.939090 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:31.939396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:31.942615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:31.966002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 281/542] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:53:31.968176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 262/543] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:31.975944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e374b3-30bc-42d2-8bb6-3aaa133a8363 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:32.078979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e374b3-30bc-42d2-8bb6-3aaa133a8363 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:32.090127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:32.119485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:32.120496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:32.120966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:32.121443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:32.139832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:32.142480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:32.168409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:32.176340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:32.179603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 282/544] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:32.191153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:32.326349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd83795-80fd-433c-ba3a-c95b3550e5a7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:32.327787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:32.369041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:32.383677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:32.384333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:32.384629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:32.384910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:32.385636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:32.385975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:32.387474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:32.415007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 263/545] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:32.416756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:32.512022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b08c1-22f0-42d1-b677-f4abfee8ce4d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:32.546169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8fa07-eac5-4687-a0aa-296c73d2c33f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:32.550487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:32.551342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:32.551845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:32.552306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:32.553177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:32.554633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:32.574275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 283/546] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:53:32 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:32.576687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:32.601376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecedd4-a738-4f3d-bf48-c43dd1a26e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:32.602515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecedd4-a738-4f3d-bf48-c43dd1a26e8d None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:32.603076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecedd4-a738-4f3d-bf48-c43dd1a26e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:32.603612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecedd4-a738-4f3d-bf48-c43dd1a26e8d None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/822b518d691f4c0fa54e2bc41144ff62/roles/73eca01d2c8f437dac85693be9186f9b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:32.626207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecedd4-a738-4f3d-bf48-c43dd1a26e8d None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=822b518d691f4c0fa54e2bc41144ff62, role_id=73eca01d2c8f437dac85693be9186f9b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:32.626207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecedd4-a738-4f3d-bf48-c43dd1a26e8d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:32.626512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:32.643823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 264/547] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:32 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/822b518d691f4c0fa54e2bc41144ff62/roles/73eca01d2c8f437dac85693be9186f9b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:32.645428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3c25-f094-4502-8e03-04dcc47ac537 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:32.645815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3c25-f094-4502-8e03-04dcc47ac537 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:32.646180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3c25-f094-4502-8e03-04dcc47ac537 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:32.652118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 265/548] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:32.656646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069c8c3-1814-40d8-940c-91b32b70c41d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:32.656988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069c8c3-1814-40d8-940c-91b32b70c41d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:32.657186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069c8c3-1814-40d8-940c-91b32b70c41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:32.697140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9069c8c3-1814-40d8-940c-91b32b70c41d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:32.698422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9069c8c3-1814-40d8-940c-91b32b70c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:32.704970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:32.792906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca282d-229c-4925-a4a2-e64f0ff1987a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:32.826339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 266/549] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:32 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 19:53:32.834030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:32.835050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:32.835533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:32.835999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:32.848786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:32.854604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:32.855583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:32.856546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:32.858981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 284/550] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:32.865780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069c8c3-1814-40d8-940c-91b32b70c41d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:32.985819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069c8c3-1814-40d8-940c-91b32b70c41d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:33.021021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8eed-7935-4d8a-88b5-71c212e059f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:33.021638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8eed-7935-4d8a-88b5-71c212e059f8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.021922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8eed-7935-4d8a-88b5-71c212e059f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.022224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8eed-7935-4d8a-88b5-71c212e059f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.022895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8eed-7935-4d8a-88b5-71c212e059f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:33.023198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8eed-7935-4d8a-88b5-71c212e059f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:33.024567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8eed-7935-4d8a-88b5-71c212e059f8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:33.030865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:33.037505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 267/551] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:33.041138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:33.064571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a734-6ed9-434a-8e6a-e590ace7159c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.064894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a734-6ed9-434a-8e6a-e590ace7159c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.065135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a734-6ed9-434a-8e6a-e590ace7159c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.066803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 268/552] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:33.072139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330af9-abe6-45f3-8c85-4633905e0510 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.072422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330af9-abe6-45f3-8c85-4633905e0510 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.072700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330af9-abe6-45f3-8c85-4633905e0510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.105668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-12330af9-abe6-45f3-8c85-4633905e0510 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:33.107419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-12330af9-abe6-45f3-8c85-4633905e0510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:33.212249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 269/553] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:33 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 19:53:33.213140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330af9-abe6-45f3-8c85-4633905e0510 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:33.242163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:33.256002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a74c8-57dc-4943-b691-a25b2db51e87 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:33.337129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:33.338190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.338648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.339099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.366264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:33.367840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:33.390054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:33.391103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:33.391978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:33.391978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:33.391978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:33.392340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 285/554] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:33.397991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:33.409594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330af9-abe6-45f3-8c85-4633905e0510 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:33.446884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:33.466782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:33.468592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.469100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.469712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.476228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:33.477932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:33.509178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 270/555] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:53:33 2022] POST /identity/v3/services => generated 251 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:33.529493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:33.637439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4f72-d374-4080-a57f-f35657e70807 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:33.726326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:33.726943 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.727219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.727500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.728128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:33.728422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:33.729799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:33.750711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:33.754175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 286/556] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:33.756493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:33.761213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed7dc4-9946-43e5-a09b-a4bc1a2d771a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:33.812122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:33.814099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.814099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.814099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.827076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:33.834798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:33.835759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:33.836605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:33.837245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 271/557] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:33.845055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:33.913871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:33.919754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d00b3-ed3a-43b4-beb9-dcbc9a2a7a69 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:33.972623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:33.972988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:33.973270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:33.973534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:33.987205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:33.988650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:33.993194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b94833-7e25-4d7f-a296-a1f5aa6ccb52 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:34.002244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:34.003225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:34.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 287/558] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Oct 23 19:53:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:34.010686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:34.065693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:34.066259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:34.066541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:34.066815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:34.067484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:34.067785 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:34.069986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:34.079026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 272/559] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:34.086248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:34.133040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:34.217597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab401c87-aec7-4281-9860-31a4a5b4ad8c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:34.238493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:34.245093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd54100-810b-4df3-bf59-ada6c1e6d9c6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:34.269610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:34.270267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:34.270601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:34.270894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:34.292196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:34.293636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:34.321020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:34.321561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:34.324067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:34.324352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:34.325334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:34.325699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:34.327941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:34.332140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:34.333255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:34.334648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:34.334648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:34.334648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:34.334648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 273/560] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:34.341504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:34.362438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 288/561] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Oct 23 19:53:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:34.371156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:34.521364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bb336-a485-4fac-a066-9ff692f2afae None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:34.547065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:34.553490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90142-3cd0-406a-815f-1ae9b0ef78d3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:34.586781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:34.587402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:34.587686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:34.587961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:34.607697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:34.608317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:34.608745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:34.609021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:34.609683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:34.609987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:34.612193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:34.635318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 274/562] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:34.640567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:34.691827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:34.692741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:34.694538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:34.795992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391e5d-9da6-450f-8025-573f47bcf25e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:34.838254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:34.838825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:34.839104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:34.839373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:34.849675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:34.851217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:34.861840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 289/563] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:34.864674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:34.866812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:34.868971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 275/564] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:34.869885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:34.875888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:34.910119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:35.003772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:35.025192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99dd9-9248-4465-a8a8-7ab63dc22391 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.073405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366c5a-e0ca-4c8d-bc79-3748215fcb1a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.088884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:35.089427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.089709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.089978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.090761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:35.092057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:35.093068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:35.123262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 276/565] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Oct 23 19:53:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:35.129691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:35.141897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:35.142566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.142847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.143119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.158979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:35.160424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:35.177578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:35.178584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:35.179479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:35.179479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:35.179479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:35.184202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 290/566] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:35.190343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:35.296702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b366559-25b3-48b5-bc93-105375e9744d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.340391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:35.374757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c20c5e-04a7-42d6-909e-d68d6b7ad750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:35.375402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c20c5e-04a7-42d6-909e-d68d6b7ad750 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.375681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c20c5e-04a7-42d6-909e-d68d6b7ad750 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.375950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c20c5e-04a7-42d6-909e-d68d6b7ad750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.401948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c20c5e-04a7-42d6-909e-d68d6b7ad750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:35.405660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c20c5e-04a7-42d6-909e-d68d6b7ad750 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:35.408617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:35.413268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2adbd-20d6-4fc3-9e03-59d3df3388ca None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-05c20c5e-04a7-42d6-909e-d68d6b7ad750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:35.438613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:35.439593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:35.440506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:35.440506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:35.440506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:35.442878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 277/567] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:35.445874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74094-a307-4d57-99b7-c39641c05cf0 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.446186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74094-a307-4d57-99b7-c39641c05cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.446464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74094-a307-4d57-99b7-c39641c05cf0 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.448237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 278/568] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:35.448988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc74094-a307-4d57-99b7-c39641c05cf0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:35.475621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62539c24-f38d-40eb-acc7-a2b4eae4cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:35.476232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539c24-f38d-40eb-acc7-a2b4eae4cda5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.476511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539c24-f38d-40eb-acc7-a2b4eae4cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.476783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62539c24-f38d-40eb-acc7-a2b4eae4cda5 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.477944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539c24-f38d-40eb-acc7-a2b4eae4cda5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:35.478279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539c24-f38d-40eb-acc7-a2b4eae4cda5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:35.480281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62539c24-f38d-40eb-acc7-a2b4eae4cda5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:35.493270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 291/569] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:35.494468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea5483-f4f1-4551-aec3-d8ce1e0f51f7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.494752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea5483-f4f1-4551-aec3-d8ce1e0f51f7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.495023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea5483-f4f1-4551-aec3-d8ce1e0f51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.514005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d7ea5483-f4f1-4551-aec3-d8ce1e0f51f7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:35.515212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d7ea5483-f4f1-4551-aec3-d8ce1e0f51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:35.568774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc74094-a307-4d57-99b7-c39641c05cf0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.587455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 292/570] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:35.588921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad097045-1acd-4dea-b33a-7c59738dbd02 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.589353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad097045-1acd-4dea-b33a-7c59738dbd02 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.589627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad097045-1acd-4dea-b33a-7c59738dbd02 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.595608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 293/571] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:35.595608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad097045-1acd-4dea-b33a-7c59738dbd02 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:35.619965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8cdb5-c739-462f-aed8-5f9dd042e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:35.620899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8cdb5-c739-462f-aed8-5f9dd042e9ca None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.621387 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8cdb5-c739-462f-aed8-5f9dd042e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.621836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8cdb5-c739-462f-aed8-5f9dd042e9ca None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.622990 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8cdb5-c739-462f-aed8-5f9dd042e9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:35.623481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8cdb5-c739-462f-aed8-5f9dd042e9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:35.625015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8cdb5-c739-462f-aed8-5f9dd042e9ca None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:35.642521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 279/572] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:35.644126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b6b0-6da0-4a55-94e2-42f94a3b406a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.644601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b6b0-6da0-4a55-94e2-42f94a3b406a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.645055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89b6b0-6da0-4a55-94e2-42f94a3b406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.665445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bb89b6b0-6da0-4a55-94e2-42f94a3b406a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:35.666988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bb89b6b0-6da0-4a55-94e2-42f94a3b406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:35.668562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:35.720447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:35.725498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad097045-1acd-4dea-b33a-7c59738dbd02 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.746131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 280/573] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:35.746131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89b6b0-6da0-4a55-94e2-42f94a3b406a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:35.791129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:35.793186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.793809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.794982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.807828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:35.810788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:35.823142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:35.824325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:35.826207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:35.828268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 294/574] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:35.833922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:35.929768 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89b6b0-6da0-4a55-94e2-42f94a3b406a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.968936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911327-8b94-420b-9882-f869e38d9883 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:35.977425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:35.978735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:35.979170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:35.979591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:35.992322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:35.995829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:35.998340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:36.010313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:36.011223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 281/575] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:36.012104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.019596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.020479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.020974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.021466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.023010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:36.023532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.026056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.043464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 295/576] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:36.045090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.068889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:36.137417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae198-55ad-4cc5-ad97-6ae2a97fa0bd None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.151953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0888f8d-c07f-4c17-a85e-77d493fd7030 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.181405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.182407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.182736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.183014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] PATH_INFO: `/v3/services/network` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.183595 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.185052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.193442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.194042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.194347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:36.194553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:36.195548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:36.199349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:36.200708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.200708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:36.200708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.200915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 282/577] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:36.200915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.201068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.214598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 296/578] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:36.215642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.260388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:36.307221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c9fe-9516-4c97-aed6-a80e7631e81f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.318103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:36.322210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af037d-43ab-456b-99e1-8cc182548fb4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.342546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.343147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.343429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.343705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.344426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=155cc268d5ef4e47bb7a16093a360ba7) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:36.344736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.346175 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.352872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 283/579] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/role_assignments?user.id=155cc268d5ef4e47bb7a16093a360ba7&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:36.353670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.365472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.366162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.366444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.366719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.382058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:36.388139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:36.394847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 297/580] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:36.396002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.488770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89bcc1-c2dd-42c9-a1e4-6fb719ea87df None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.514650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:36.519047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad076b-75db-4a89-a82f-6a9f042e05d2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.527570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ca2cc-2c2f-4330-b133-c7f853538c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.528182 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ca2cc-2c2f-4330-b133-c7f853538c16 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.528983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ca2cc-2c2f-4330-b133-c7f853538c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.529828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ca2cc-2c2f-4330-b133-c7f853538c16 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.530490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ca2cc-2c2f-4330-b133-c7f853538c16 None admin] RBAC: Adding query filter params (name=network) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:36.530798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ca2cc-2c2f-4330-b133-c7f853538c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.532147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ca2cc-2c2f-4330-b133-c7f853538c16 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.537736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 284/581] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:36.538970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751092c8-3d8a-463a-92f6-fb462fe6aae8 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.539208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751092c8-3d8a-463a-92f6-fb462fe6aae8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.539482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751092c8-3d8a-463a-92f6-fb462fe6aae8 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.540665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 285/582] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:36.541363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751092c8-3d8a-463a-92f6-fb462fe6aae8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.564585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.565567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.566042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.566523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/5ddd37ebc3874a8f8a8d60c0a32bf090/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.568913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=5ddd37ebc3874a8f8a8d60c0a32bf090, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.570401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.583631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:36.585050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 298/583] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:36 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/5ddd37ebc3874a8f8a8d60c0a32bf090/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:36.585759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.672263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751092c8-3d8a-463a-92f6-fb462fe6aae8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.718539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6045d4-9472-4c9f-ab75-d4b6a1003188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.719500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6045d4-9472-4c9f-ab75-d4b6a1003188 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.720005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6045d4-9472-4c9f-ab75-d4b6a1003188 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.720468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6045d4-9472-4c9f-ab75-d4b6a1003188 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.721384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6045d4-9472-4c9f-ab75-d4b6a1003188 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:36.721940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6045d4-9472-4c9f-ab75-d4b6a1003188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.723609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6045d4-9472-4c9f-ab75-d4b6a1003188 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.732753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10727b-a4ba-4b8b-9839-a9b317b90cfe None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:36.734934 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 286/584] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:36.736498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21694b6b-eddc-4d19-994d-4617612464bd None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.737008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21694b6b-eddc-4d19-994d-4617612464bd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.737501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21694b6b-eddc-4d19-994d-4617612464bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.758523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-21694b6b-eddc-4d19-994d-4617612464bd None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:36.760124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-21694b6b-eddc-4d19-994d-4617612464bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:36.789711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:36.790349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:36.790633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:36.790906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:36.791796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:36.792105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:36.796216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:36.801212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 299/585] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:36.806181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.833873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:36.849035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 287/586] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:36.854205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21694b6b-eddc-4d19-994d-4617612464bd None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:36.900374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:36.940116 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceaf94-3a6c-44cb-856d-cfc3fa4c3ab8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.019998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.020485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.020764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.021034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.029840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21694b6b-eddc-4d19-994d-4617612464bd None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.041634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.043108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.067519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.068409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:37.068582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:37.069745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:37.070895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:37.070895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:37.070895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:37.070895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 300/587] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:37.071746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.072243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.073083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] RBAC: Adding query filter params (interface=public, service_id=5eb8f854451b44afb264fe8ffc4d4ae8, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:37.073540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.075058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.077301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.084596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 288/588] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:53:36 2022] GET /identity/v3/endpoints?service_id=5eb8f854451b44afb264fe8ffc4d4ae8&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:37.097811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.209921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:37.220156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61f7cf-1685-4091-8134-d9377a74b121 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.226158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:37.256038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.256808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.257191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.257566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.258309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.258850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712d9cb-e62c-46f1-aab8-0acc5d640a82 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.259874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.272585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 289/589] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:37.272585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.367763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.368429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.368674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.368947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.369606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:37.369908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.371324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.381385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52683ba-4516-4cab-8f82-600a9aeddb5d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.412503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 301/590] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:37.420163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.420955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.421337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.421711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.422459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.423149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.424127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:37.434525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:37.435977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:37.437302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:37.439169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 290/591] 10.222.0.18 () {56 vars in 1129 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:37.445076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.474420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:37.577911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e9820-6d47-491f-b026-708921a6c1c8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.580879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc2fa8-8185-46ca-96c3-105c30a7f25e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.617378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.618069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.618467 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.618949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.619908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:37.620315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.625155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.625314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.625394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.625394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.625394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.625394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:37.633010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.633316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 291/592] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:37.634680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.634794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:37.648621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:37.649646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:37.650632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 302/593] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:37.659054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.802260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba31f34-5832-4f72-bb84-b275d2378677 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.804788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:37.837120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c5883-adbd-4d34-be5a-5c8776b30720 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:37.844973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.845585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.845864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.846179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.846922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:37.847757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.849195 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.869999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 303/594] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:37.879039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.910546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:37.911390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:37.911835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:37.912258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:37.913044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:37.913512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:37.915040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:37.924711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 292/595] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:37.930414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:37.994219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:38.075721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41816b-0a85-440c-b456-b0b0f6a64cde None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:38.087085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab603a9-13ae-416a-80d5-5e743765a410 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:38.141721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:38.143017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:38.143903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:38.144798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:38.149398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:38.150193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:38.150631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:38.152623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:38.154035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] RBAC: Adding query filter params (interface=public, service_id=04dc2b049e6b436cb67457fbb10cfaec, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:38.154528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:38.156306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:38.168671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 293/596] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/endpoints?service_id=04dc2b049e6b436cb67457fbb10cfaec&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:38.175166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:38.224012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:38.256734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:38.258657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:38.356987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:38.414484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 304/597] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:53:38.424624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:38.518641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8cfc6-8b54-47a5-a0cc-168298368d5e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:38.592974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:38.593968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:38.594620 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:38.595944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:38.598756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:38.600361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:38.613963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 294/598] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:53:38 2022] GET /identity/v3/services => generated 772 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:38.630534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af414-157f-467b-b80f-446d1eb49138 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:38.707703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd397fa-9907-44d6-9266-cf360d14c730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:38.708763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd397fa-9907-44d6-9266-cf360d14c730 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:38.709249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd397fa-9907-44d6-9266-cf360d14c730 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:38.709733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd397fa-9907-44d6-9266-cf360d14c730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:38.734282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd397fa-9907-44d6-9266-cf360d14c730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:38.736131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd397fa-9907-44d6-9266-cf360d14c730 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-ecd397fa-9907-44d6-9266-cf360d14c730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:38.767798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:38.768804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:38.769696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:38.769696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:38.769696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:38.771661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 305/599] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:38.777735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:38.877038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:38.914591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a149-7b16-4575-8a2f-5b22b3839fea None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:38.920512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010b36-9f91-4cc3-a60d-8b7a16020ee3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:38.921003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010b36-9f91-4cc3-a60d-8b7a16020ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:38.921087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010b36-9f91-4cc3-a60d-8b7a16020ee3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:38.926151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 306/600] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:38.928085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853a635-9234-4a21-9939-571271bb79ea None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:38.928367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853a635-9234-4a21-9939-571271bb79ea None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:38.928638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853a635-9234-4a21-9939-571271bb79ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:38.940238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:38.960957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2853a635-9234-4a21-9939-571271bb79ea None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:38.962101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2853a635-9234-4a21-9939-571271bb79ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:38.993315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:38.993933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:38.994244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:38.994517 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:38.995165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:38.995469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:38.996831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:39.025924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 295/601] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:39.031409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:39.116846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 307/602] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:39.176834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6169eb-fee8-4037-ad11-4373ce111646 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:39.220925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:39.221570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:39.221852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:39.222137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:39.222606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffad67-1a61-4da4-aaf0-48409aafd0f6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:39.222898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffad67-1a61-4da4-aaf0-48409aafd0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:39.223179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffad67-1a61-4da4-aaf0-48409aafd0f6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:39.225953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 308/603] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:53:39.229547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:39.230047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815986-a79f-45d8-af87-c0ae63676dc8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:39.230365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815986-a79f-45d8-af87-c0ae63676dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:39.230642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815986-a79f-45d8-af87-c0ae63676dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:39.231019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:39.234409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:39.251447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a7815986-a79f-45d8-af87-c0ae63676dc8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:39.252649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a7815986-a79f-45d8-af87-c0ae63676dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:39.254907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:39.255801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:39.257906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:39.262396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 296/604] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:39.266016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:39.371014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 309/605] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:53:39.428222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753176-6d5d-47cb-9a69-943faedde534 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:39.443217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815986-a79f-45d8-af87-c0ae63676dc8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:39.484964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:39.485492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:39.485772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:39.486043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:39.487697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:39.488009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:39.489442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:39.515727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 297/606] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:39.522613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:39.558131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:39.631693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:39.639754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815986-a79f-45d8-af87-c0ae63676dc8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:39.705322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:39.705956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:39.706273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:39.706548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:39.707138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:39.708512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:39.710748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f5997-a710-4adc-9bdf-0b63e153150a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:39.722273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:39.723262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:39.724737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 310/607] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Oct 23 19:53:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:39.729428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:39.763690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:39.764671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:39.765375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:39.766276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:39.767554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] RBAC: Adding query filter params (role.id=73eca01d2c8f437dac85693be9186f9b, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=822b518d691f4c0fa54e2bc41144ff62) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:39.768132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:39.769999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:39.776661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 298/608] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:39 2022] GET /identity/v3/role_assignments?user.id=822b518d691f4c0fa54e2bc41144ff62&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=73eca01d2c8f437dac85693be9186f9b => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:39.777833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:39.910428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b6ed-d61b-459e-9e9a-8f5fd1b8fec6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:39.974506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:39.992690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:39.993838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:39.995198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:39.995891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:39.998452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:39.999887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:40.001644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:40.005863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70902b7-d548-4b4e-8f2d-04c8d55a4f1c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:40.016053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 311/609] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:40.021620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:40.032463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:40.055219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:40.056034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.056430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.056800 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:40.067952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:40.075728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:40.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:53:40.077810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:40.081462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 299/610] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:40.082799 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:40.148748 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303f83f-e6bb-4464-89d4-02346d2a92bf None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:40.196083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a72c-dd94-47be-9250-01be601df19f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:40.202667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623116c-7d67-44d9-b2fd-edc4f49744f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:40.203961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623116c-7d67-44d9-b2fd-edc4f49744f6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.204436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623116c-7d67-44d9-b2fd-edc4f49744f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.204749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623116c-7d67-44d9-b2fd-edc4f49744f6 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:40.205942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623116c-7d67-44d9-b2fd-edc4f49744f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:40.206368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623116c-7d67-44d9-b2fd-edc4f49744f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:40.208537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623116c-7d67-44d9-b2fd-edc4f49744f6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:40.215065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 312/611] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:40.216990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a274f-9bd5-45cc-8d78-e48a4949ce1a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.217440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a274f-9bd5-45cc-8d78-e48a4949ce1a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.218422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a274f-9bd5-45cc-8d78-e48a4949ce1a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:40.220152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 313/612] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:40.225491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8321-6711-4dde-83c9-23b5f27b311d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.225897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8321-6711-4dde-83c9-23b5f27b311d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.227170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8321-6711-4dde-83c9-23b5f27b311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:40.258462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:40.259263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.259646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.262422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:40.263634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:40.263634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:40.265978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:40.275349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cecf8321-6711-4dde-83c9-23b5f27b311d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:40.276527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cecf8321-6711-4dde-83c9-23b5f27b311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:40.284619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 300/613] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:40.286195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:40.392893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:40.404035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:40.420224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 314/614] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:40.479953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd7ace-077b-4d46-9bcf-12a08e40f15d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:40.515390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:40.516288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.516715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.517143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:40.528489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:40.530704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:40.546315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:40.547484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:40.548601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:40.548601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:40.548601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:40.550305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 301/615] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:40.557823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf8321-6711-4dde-83c9-23b5f27b311d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:40.707912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf8321-6711-4dde-83c9-23b5f27b311d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:40.749378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:40.749999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.750317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.750594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:40.751257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:40.751563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:40.753000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:40.772533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 315/616] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:40.780377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:40.899475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:40.904766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:40.910235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0f016-b660-4e18-a442-8b15c675478a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:40.985913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:40.986623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:40.986907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:40.987180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.003328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.004994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:41.006284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:41.029083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:41.030306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:41.031721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 302/617] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:53:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:41.037965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:41.117407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015197a8-8aa2-4aa4-8487-48d700451dd0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:41.182447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:41.183081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.183459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.183736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] PATH_INFO: `/v3/services/network` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.184325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.186605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:41.204568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:41.205634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:41.206919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 316/618] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:40 2022] GET /identity/v3/services/network => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:41.212690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208cd77-638d-4bb8-ae45-582276af6472 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:41.217090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:41.253059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584a245-8b5e-4445-89aa-667369c05e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:41.253673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a245-8b5e-4445-89aa-667369c05e0d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.253953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a245-8b5e-4445-89aa-667369c05e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.254257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a245-8b5e-4445-89aa-667369c05e0d None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.255099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584a245-8b5e-4445-89aa-667369c05e0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:41.255408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584a245-8b5e-4445-89aa-667369c05e0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.256808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584a245-8b5e-4445-89aa-667369c05e0d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:41.279273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 303/619] 10.222.0.18 () {56 vars in 1135 bytes} [Sun Oct 23 19:53:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:41.284215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf1483-e5a0-4e2a-875c-5d66d2c12529 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.284215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf1483-e5a0-4e2a-875c-5d66d2c12529 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.284215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf1483-e5a0-4e2a-875c-5d66d2c12529 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.284215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 304/620] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:41.285160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf1483-e5a0-4e2a-875c-5d66d2c12529 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:41.302454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:41.375362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3259bc2-a211-4e1e-a7b0-f6a38adaa864 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:41.394463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:41.402901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf1483-e5a0-4e2a-875c-5d66d2c12529 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:41.421889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404c8b5-7d4f-46b2-8c5a-75d8f86cd2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:41.422563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c8b5-7d4f-46b2-8c5a-75d8f86cd2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.422844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c8b5-7d4f-46b2-8c5a-75d8f86cd2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.423119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c8b5-7d4f-46b2-8c5a-75d8f86cd2d5 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.424096 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c8b5-7d4f-46b2-8c5a-75d8f86cd2d5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:41.424214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c8b5-7d4f-46b2-8c5a-75d8f86cd2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.425573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c8b5-7d4f-46b2-8c5a-75d8f86cd2d5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:41.431444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 317/621] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:41.433145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3030-9ea9-402c-a50a-5210743b8b81 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.433145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3030-9ea9-402c-a50a-5210743b8b81 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.433432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d3030-9ea9-402c-a50a-5210743b8b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.454065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0b1d3030-9ea9-402c-a50a-5210743b8b81 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:41.454886 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:41.455269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0b1d3030-9ea9-402c-a50a-5210743b8b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:41.456003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.456516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.457290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.532016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 318/622] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:41.533646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d3030-9ea9-402c-a50a-5210743b8b81 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:41.540279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.541726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:41.556487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:41.659776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d3030-9ea9-402c-a50a-5210743b8b81 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:41.663332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:41.675580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 305/623] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:53:41.676590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:41.726919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:41.727870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.728336 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.728867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.729669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] RBAC: Adding query filter params (type=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:41.734246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.736129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:41.744764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 319/624] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:41.750897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:41.795106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a2360-bd8d-40df-915f-f0fcd3872add None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:41.819191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:41.836711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:41.837357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.837678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.839099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.860643 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.862133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:41.882769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:41.883773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:41.884660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:41.884660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:41.884660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:41.885242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 306/625] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:41.889237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:41.930771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e3820-d697-4db2-877a-73ff391eb86b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:41.976007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:41.976987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:41.977278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:41.977556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:41.978485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:41.980486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.006169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610f6d-4ec3-43d4-a4ba-ed937286f941 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.012439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 320/626] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:53:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:53:42.013580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.066334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:42.073428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.074102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.074408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.078340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.079086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.082421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:42.103388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:42.104463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 19:53:42.105309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:42.108655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 307/627] 10.222.0.18 () {56 vars in 1129 bytes} [Sun Oct 23 19:53:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:42.114322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.161159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:42.210691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9ac98-62ae-40d1-a51c-b307fffbabb6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.269324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.269940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.270253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.270529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.271183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:42.271552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.275037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.292902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 321/628] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:42.299511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.310616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86094533-0f1b-4396-b0f9-21cc6f0ea91a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.358848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.360736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.361480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.361953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.362827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:42.363313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.364849 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.374656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 308/629] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Oct 23 19:53:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:42.378769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.411290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:42.433783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4eba4-79fd-4346-846f-b8427a886c6b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.476559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1a708-a324-4495-959c-47113b6d12db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.477210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a708-a324-4495-959c-47113b6d12db None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.477488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a708-a324-4495-959c-47113b6d12db None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.477757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a708-a324-4495-959c-47113b6d12db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.485940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1a708-a324-4495-959c-47113b6d12db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.487641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1a708-a324-4495-959c-47113b6d12db None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-00f1a708-a324-4495-959c-47113b6d12db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:42.504006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:42.504955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:42.505838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 322/630] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:42.506342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:42.507213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b9d05-cc9a-4f26-9d86-bd2e1530f72a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.507213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b9d05-cc9a-4f26-9d86-bd2e1530f72a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.507213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b9d05-cc9a-4f26-9d86-bd2e1530f72a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.511979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 323/631] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:42.514105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b9d05-cc9a-4f26-9d86-bd2e1530f72a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.523697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c836e-23d4-42f7-a5a5-1a9af6033572 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.566713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79ee76-87bf-4e5c-8a17-99fa1e5f11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.567320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79ee76-87bf-4e5c-8a17-99fa1e5f11ed None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.567602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79ee76-87bf-4e5c-8a17-99fa1e5f11ed None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.567883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79ee76-87bf-4e5c-8a17-99fa1e5f11ed None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.568494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79ee76-87bf-4e5c-8a17-99fa1e5f11ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:42.568794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79ee76-87bf-4e5c-8a17-99fa1e5f11ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.570166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79ee76-87bf-4e5c-8a17-99fa1e5f11ed None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.579813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 309/632] 10.222.0.18 () {56 vars in 1124 bytes} [Sun Oct 23 19:53:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:42.579813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ccd84-301f-4a04-bd09-da161ef38b02 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.579813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ccd84-301f-4a04-bd09-da161ef38b02 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.579813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ccd84-301f-4a04-bd09-da161ef38b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.595647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-dd6ccd84-301f-4a04-bd09-da161ef38b02 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:42.596840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dd6ccd84-301f-4a04-bd09-da161ef38b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:42.634240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b9d05-cc9a-4f26-9d86-bd2e1530f72a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.671910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 310/633] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:42.672568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ccd84-301f-4a04-bd09-da161ef38b02 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.674169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.675350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.675639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.675918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.676675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:42.676993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.678535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.694863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 324/634] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:42.700711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.708166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:42.768017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:42.787942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ccd84-301f-4a04-bd09-da161ef38b02 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.824605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828634b-497f-458d-8b3b-49c37226590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.825344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828634b-497f-458d-8b3b-49c37226590a None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.825645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828634b-497f-458d-8b3b-49c37226590a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.825920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828634b-497f-458d-8b3b-49c37226590a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.826640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828634b-497f-458d-8b3b-49c37226590a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.828010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828634b-497f-458d-8b3b-49c37226590a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.844851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad53e3-628e-41b7-a901-d124795acfe5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:42.858116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 311/635] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:53:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:42.858116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6cbd6-d80d-4820-829b-ff86b9399580 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.858116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6cbd6-d80d-4820-829b-ff86b9399580 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.858116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6cbd6-d80d-4820-829b-ff86b9399580 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.858116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 312/636] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:42.861333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0959d3e-f6b9-42f2-bbdf-d1e8cb43ec13 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.862053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0959d3e-f6b9-42f2-bbdf-d1e8cb43ec13 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.862053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0959d3e-f6b9-42f2-bbdf-d1e8cb43ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.881989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f0959d3e-f6b9-42f2-bbdf-d1e8cb43ec13 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:42.883191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f0959d3e-f6b9-42f2-bbdf-d1e8cb43ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:42.905054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:42.906268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:42.906571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:42.906837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:42.907913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=5ddd37ebc3874a8f8a8d60c0a32bf090) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:42.908228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:42.910626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:42.919227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 325/637] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:42 2022] GET /identity/v3/role_assignments?user.id=5ddd37ebc3874a8f8a8d60c0a32bf090&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:42.952457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:42.961885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 313/638] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:53:43.027774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:43.077125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cb34-6921-4c6e-90dd-cd2dd6dc4eaf None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:43.118928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:43.118928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:43.118928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:43.118928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:43.130975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:43.136780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:43.138632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:53:43.139596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:43.140244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 326/639] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Oct 23 19:53:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:43.146848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0959d3e-f6b9-42f2-bbdf-d1e8cb43ec13 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:43.226283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:43.234236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:43.269738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0959d3e-f6b9-42f2-bbdf-d1e8cb43ec13 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:43.307522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:43.308176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:43.308461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:43.308733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:43.309954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:43.310303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:43.312143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:43.321388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 314/640] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Oct 23 19:53:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:43.326593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:43.363480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384ed6c-a6de-4496-a03a-d48bcc3fa984 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:43.388710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:43.400378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:43.400987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:43.401366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:43.401623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:43.402363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:43.403797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:43.421493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 327/641] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:53:43 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:53:43.460645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae0ce-4cdc-48af-a19a-d96ae2967df6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:43.495451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:43.511839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:43.512525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:43.512910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:43.513196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:43.530883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:43.532777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:43.550151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:43.551302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:43.552350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:43.552350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:43.552350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:43.554779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 315/642] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:43.560679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:43.671810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485eaf4-77b3-4682-bc09-4dab082276dc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:43.707367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:43.708023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:43.708309 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:43.708583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:43.709278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:43.709584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:43.710973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:43.724177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 328/643] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:43.729801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:43.837257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec070-9445-4301-920f-b51f084b98f0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:43.873094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:43.873718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:43.873998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:43.874299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:43.882207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:43.883744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:43.896124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:43.897086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:43.898024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 316/644] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:53:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:43.903348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:43.955225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:44.016944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ec9a-c6e0-4aba-ab26-b14a7c9e2e67 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:44.052563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:44.053277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:44.053457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:44.053662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:44.054421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:44.054727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:44.056149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:44.074111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 329/645] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Oct 23 19:53:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:44.079750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:44.119887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:44.187165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03530-6e31-406c-b8e0-633c01533182 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:44.223225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:44.223860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:44.224142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:44.224418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:44.236030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:44.237486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:44.253645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:44.254687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:44.255593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:44.255593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:44.255593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:44.255593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 317/646] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:44.260404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:44.365932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15f7a8-5784-45f1-82f6-9d778c2c1233 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:44.374570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:44.403850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:44.404467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:44.404749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:44.405028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:44.405676 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:44.405980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:44.407455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:44.420856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 330/647] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:44.427208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:44.522949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:44.533164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a7a87-10c9-4ef7-9213-4e71d809fa2e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:44.567822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:44.568448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:44.568786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:44.569064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:44.576389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:44.577819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:44.589156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:44.590040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:44.591213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 318/648] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:44.599789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:44.711783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecebaaa-b428-4bea-95bd-7f78a2fff67e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:44.747950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df3bf-19ce-463e-bc18-f4fde575964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:44.748567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df3bf-19ce-463e-bc18-f4fde575964c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:44.748848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df3bf-19ce-463e-bc18-f4fde575964c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:44.749123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df3bf-19ce-463e-bc18-f4fde575964c None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:44.749818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df3bf-19ce-463e-bc18-f4fde575964c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:44.750151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df3bf-19ce-463e-bc18-f4fde575964c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:44.751579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df3bf-19ce-463e-bc18-f4fde575964c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:44.765131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 331/649] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:44.771184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:44.874301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5442fb6-319a-4209-a2f6-60c88b8f65dc None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:44.908607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27ce44-7c71-44a6-9f04-225863ee0578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:44.909262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27ce44-7c71-44a6-9f04-225863ee0578 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:44.909548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27ce44-7c71-44a6-9f04-225863ee0578 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:44.909820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27ce44-7c71-44a6-9f04-225863ee0578 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/822b518d691f4c0fa54e2bc41144ff62/roles/630e4775b76c4761ae25bea28d994b51` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:44.912056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27ce44-7c71-44a6-9f04-225863ee0578 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=822b518d691f4c0fa54e2bc41144ff62, role_id=630e4775b76c4761ae25bea28d994b51)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:44.913596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27ce44-7c71-44a6-9f04-225863ee0578 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:44.928533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 319/650] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:53:44 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/822b518d691f4c0fa54e2bc41144ff62/roles/630e4775b76c4761ae25bea28d994b51 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:53:45.235327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2dbd-7f23-45b1-933a-3eaec73260c6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.235850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2dbd-7f23-45b1-933a-3eaec73260c6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.235850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2dbd-7f23-45b1-933a-3eaec73260c6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.237688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 332/651] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:45.243600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc79c8-0dce-47d9-bd2a-d2251666350b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.243974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc79c8-0dce-47d9-bd2a-d2251666350b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.244350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc79c8-0dce-47d9-bd2a-d2251666350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.266262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5bfc79c8-0dce-47d9-bd2a-d2251666350b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:45.267562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5bfc79c8-0dce-47d9-bd2a-d2251666350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:45.270963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:45.344213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 320/652] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:45.378358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13a53-ef8b-4855-abdb-42ca368a6f2a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.378687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13a53-ef8b-4855-abdb-42ca368a6f2a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.378915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13a53-ef8b-4855-abdb-42ca368a6f2a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.380263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 333/653] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:45.385705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1fda-496d-4597-b428-53e9e007d3ce None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.385996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1fda-496d-4597-b428-53e9e007d3ce None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.386295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1fda-496d-4597-b428-53e9e007d3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.405743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fd2c1fda-496d-4597-b428-53e9e007d3ce None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:45.406972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fd2c1fda-496d-4597-b428-53e9e007d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:45.477411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 321/654] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:45.621034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13a53-ef8b-4855-abdb-42ca368a6f2a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:45.650268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:45.734677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13a53-ef8b-4855-abdb-42ca368a6f2a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:45.749230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c1fda-496d-4597-b428-53e9e007d3ce None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:45.771233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f778485-f88b-480c-9bd2-b179a3ce911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:45.771869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778485-f88b-480c-9bd2-b179a3ce911a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.772152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778485-f88b-480c-9bd2-b179a3ce911a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.772426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778485-f88b-480c-9bd2-b179a3ce911a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.773012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f778485-f88b-480c-9bd2-b179a3ce911a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:45.774405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f778485-f88b-480c-9bd2-b179a3ce911a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-6f778485-f88b-480c-9bd2-b179a3ce911a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:45.783946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:45.785130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:45.786154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 334/655] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:45.786968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15d3b-9929-44ea-aa9c-98c3b3e77289 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.786968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15d3b-9929-44ea-aa9c-98c3b3e77289 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.787104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15d3b-9929-44ea-aa9c-98c3b3e77289 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.788358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 335/656] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:45.795294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15d3b-9929-44ea-aa9c-98c3b3e77289 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:45.828551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:45.862203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c1fda-496d-4597-b428-53e9e007d3ce None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:45.893812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:45.899221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dc971-1c74-4b60-a55d-60830c1f8afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:45.899878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dc971-1c74-4b60-a55d-60830c1f8afc None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.900181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dc971-1c74-4b60-a55d-60830c1f8afc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.900456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dc971-1c74-4b60-a55d-60830c1f8afc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.901041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dc971-1c74-4b60-a55d-60830c1f8afc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:45.902437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dc971-1c74-4b60-a55d-60830c1f8afc None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4f7dc971-1c74-4b60-a55d-60830c1f8afc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:45.911619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:45.912585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:45.913446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:45.914654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15d3b-9929-44ea-aa9c-98c3b3e77289 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:45.914732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 322/657] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:45.914732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb23ad-7622-43c1-a607-f5b61e7abf73 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.914732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb23ad-7622-43c1-a607-f5b61e7abf73 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.914732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb23ad-7622-43c1-a607-f5b61e7abf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.932811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-72cb23ad-7622-43c1-a607-f5b61e7abf73 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:45.934001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-72cb23ad-7622-43c1-a607-f5b61e7abf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:45.953527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:45.954180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:45.954467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:45.954746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:45.955373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:45.955675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:45.957033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:45.966469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 336/658] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:45.966469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:46.015290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 323/659] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:46.020160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb23ad-7622-43c1-a607-f5b61e7abf73 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:46.074528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac658d-c901-4400-925f-11b0c888078e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:46.103850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:46.111774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:46.112696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:46.113186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:46.113659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:46.114624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:46.115228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:46.116814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:46.127535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 337/660] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:53:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:46.129098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:46.146340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:46.149568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb23ad-7622-43c1-a607-f5b61e7abf73 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:46.194720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:46.195333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:46.195614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:46.195888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:46.196518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:46.196824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:46.198203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:46.204080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 324/661] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:46.261768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed59d5-9993-494b-9dac-f234e975ff4a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:46.289850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:46.316038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:46.317030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:46.317514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:46.318008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:46.318881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:46.319407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:46.321081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:46.327125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 338/662] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:53:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:46.436964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f6cee-4da1-4486-84c7-dc128a6d1f07 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:46.468296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:46.477564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:46.478250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:46.478576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:46.478856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:46.479460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:46.480864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:46.491447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:46.492434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:46.493328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 325/663] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Oct 23 19:53:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:46.501808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:46.589775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:46.614153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afb48e-6e82-4c49-81d6-f7e3fb133984 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:46.650536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:46.651145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:46.651424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:46.651692 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:46.652324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:46.652628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:46.655226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:46.660632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 339/664] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:46.666418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:46.775741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bd4e-e74c-4654-b5a0-e324e58ddcfd None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:46.814906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:46.815520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:46.815801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:46.816077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:46.816709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:46.817013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:46.818458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:46.823924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 326/665] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:46.830366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:46.940517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735084e4-a30f-40e5-8dae-e45398a0eef0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:46.975909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d94a6-b6c9-408a-ab14-41c7c8e74d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:46.976517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d94a6-b6c9-408a-ab14-41c7c8e74d64 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:46.976797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d94a6-b6c9-408a-ab14-41c7c8e74d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:46.977069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d94a6-b6c9-408a-ab14-41c7c8e74d64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:46.977764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d94a6-b6c9-408a-ab14-41c7c8e74d64 None admin] RBAC: Adding query filter params (interface=public, service_id=ab22eefcfb4a431d9d00781c62ee2662, region_id=RegionOne) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:46.978068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d94a6-b6c9-408a-ab14-41c7c8e74d64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:46.979530 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d94a6-b6c9-408a-ab14-41c7c8e74d64 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:46.987643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 340/666] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:53:46 2022] GET /identity/v3/endpoints?service_id=ab22eefcfb4a431d9d00781c62ee2662&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:46.995227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:47.056824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:47.108846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d0ef9-1d4d-4483-9ce8-4336353edd52 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:47.144341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d38e3-a9ff-4a3f-a43c-349c1d5c40cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:47.145287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d38e3-a9ff-4a3f-a43c-349c1d5c40cc None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:47.145760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d38e3-a9ff-4a3f-a43c-349c1d5c40cc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:47.146242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d38e3-a9ff-4a3f-a43c-349c1d5c40cc None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:47.147028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d38e3-a9ff-4a3f-a43c-349c1d5c40cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:47.148623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d38e3-a9ff-4a3f-a43c-349c1d5c40cc None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:47.155327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 327/667] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:53:46 2022] GET /identity/v3/services => generated 1029 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 19:53:47.183763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3d8e-f385-472b-b29f-c4cf74ad459e None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:47.184064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3d8e-f385-472b-b29f-c4cf74ad459e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:47.184903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3d8e-f385-472b-b29f-c4cf74ad459e None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:47.187060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 341/668] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:47.192917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d1c3-dc1c-4eca-bd7e-8eec6bced0a3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:47.193211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d1c3-dc1c-4eca-bd7e-8eec6bced0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:47.193493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d1c3-dc1c-4eca-bd7e-8eec6bced0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:47.213815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0e77d1c3-dc1c-4eca-bd7e-8eec6bced0a3 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:47.215128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0e77d1c3-dc1c-4eca-bd7e-8eec6bced0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:47.291975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 328/669] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:47.563902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3d8e-f385-472b-b29f-c4cf74ad459e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:47.574263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:47.688965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3d8e-f385-472b-b29f-c4cf74ad459e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:47.724853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:47.725492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:47.725774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:47.726048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:47.737409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:53:47.742356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:47.743266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:47.744100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 342/670] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Oct 23 19:53:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:47.751368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77d1c3-dc1c-4eca-bd7e-8eec6bced0a3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:47.810607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:47.852070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77d1c3-dc1c-4eca-bd7e-8eec6bced0a3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:47.887743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:47.888521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:47.888803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:47.889076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:47.889741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:47.890042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:47.891483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:47.899979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 329/671] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Oct 23 19:53:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:47.906210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:47.977461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:48.013304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f537fd7-7a2c-4f1c-a18a-b5b347a998e3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:48.048369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:48.048994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.049273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.049543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.061987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:48.063494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:48.078907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:48.080151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:48.081338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:48.081338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:48.081338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:48.081338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 343/672] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:48.091438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:48.193550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68169d-4acf-44d2-9aad-4033a4e3ed52 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:48.207470 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:48.228950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:48.229609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.229891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.230222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.230874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:48.231718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:48.233057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:48.245338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 330/673] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:48.251378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:48.358041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b90a-7218-4413-9365-e71ff9d525b6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:48.376115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:48.394471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e039ebc-90f0-45b4-96f9-2b96d866c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:48.395105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039ebc-90f0-45b4-96f9-2b96d866c9ec None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.395388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039ebc-90f0-45b4-96f9-2b96d866c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.395662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039ebc-90f0-45b4-96f9-2b96d866c9ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.404033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e039ebc-90f0-45b4-96f9-2b96d866c9ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:48.405469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e039ebc-90f0-45b4-96f9-2b96d866c9ec None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-4e039ebc-90f0-45b4-96f9-2b96d866c9ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:53:48.422165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:48.423155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:48.424455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 344/674] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:53:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:48.429084 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:48.545445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674fe59-71fe-43a6-b27c-5310e4b91450 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:48.583506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:48.584112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.584392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.584663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.585400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:48.585703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:48.587140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:48.591481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772e0c-0d34-4ae4-ac76-4a74228c9fd3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.592408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772e0c-0d34-4ae4-ac76-4a74228c9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.592926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85772e0c-0d34-4ae4-ac76-4a74228c9fd3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.598408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 345/675] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:48.600227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c664c-044d-4a0d-860a-b3a327bc2220 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.600722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c664c-044d-4a0d-860a-b3a327bc2220 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.601196 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c664c-044d-4a0d-860a-b3a327bc2220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.606185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 331/676] 10.222.0.18 () {56 vars in 1149 bytes} [Sun Oct 23 19:53:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:48.611441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:48.632219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3a9c664c-044d-4a0d-860a-b3a327bc2220 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:48.633747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3a9c664c-044d-4a0d-860a-b3a327bc2220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:48.643043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:48.706551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 346/677] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:48 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:53:48.707813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7257-b23a-4783-bfb7-25a6e19ed318 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.708098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7257-b23a-4783-bfb7-25a6e19ed318 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.708368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e7257-b23a-4783-bfb7-25a6e19ed318 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.709727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 347/678] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:48.714854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66991c2-2018-491b-987b-14bed5cf6c8d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.715139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66991c2-2018-491b-987b-14bed5cf6c8d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.715421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66991c2-2018-491b-987b-14bed5cf6c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.722447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4fe2-9abe-429c-a747-95ade1791787 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:48.735307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f66991c2-2018-491b-987b-14bed5cf6c8d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:48.736979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f66991c2-2018-491b-987b-14bed5cf6c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:48.770428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:48.771977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:48.772586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:48.773114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:48.825519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 348/679] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:48 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:53:48.853779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:48.855539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:48.886550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:48.960897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 332/680] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:53:48 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:53:48.970328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66991c2-2018-491b-987b-14bed5cf6c8d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:48.987718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:49.014574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:49.088987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66991c2-2018-491b-987b-14bed5cf6c8d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:49.113322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a71d-7824-4539-aa39-58e9acead556 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:49.126422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:49.127056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.127342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.127614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.138410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:49.139953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:49.145614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:49.152664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:49.153472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.153756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.154032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.154721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:53:49.155758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:49.156644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:53:49.162708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:53:49.162708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:53:49.162708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:49.162880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:49.162951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 349/681] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:49.162951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:49.173151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 333/682] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:53:48 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:53:49.173832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:49.281229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:49.292303 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a745cd2-23af-426c-a6f5-00a913c217fe None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:49.334634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512df6c-585e-4f5c-83c7-3131cc2c95a8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:49.339315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:49.339661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.339944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.340218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.341532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:49.343037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:49.363916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 350/683] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:53:49 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:49.385382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a39f6-9004-4e4f-ad19-60e42b8310e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:49.386005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a39f6-9004-4e4f-ad19-60e42b8310e1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.386320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a39f6-9004-4e4f-ad19-60e42b8310e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.386593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a39f6-9004-4e4f-ad19-60e42b8310e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.387256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a39f6-9004-4e4f-ad19-60e42b8310e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:49.387628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a39f6-9004-4e4f-ad19-60e42b8310e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:49.389032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a39f6-9004-4e4f-ad19-60e42b8310e1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:49.405130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 334/684] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:49.410853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:49.460615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b7ba-3434-401d-8250-03b7b63badee None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.460615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b7ba-3434-401d-8250-03b7b63badee None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.460872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b7ba-3434-401d-8250-03b7b63badee None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.462512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 335/685] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:49.469237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860757-df23-4e67-8edd-9d69f6038df9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.469603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860757-df23-4e67-8edd-9d69f6038df9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.469783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860757-df23-4e67-8edd-9d69f6038df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.491016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-51860757-df23-4e67-8edd-9d69f6038df9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:49.492924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-51860757-df23-4e67-8edd-9d69f6038df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:49.531061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1777ee-a79d-4969-9906-e1b285fb70a2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:49.538172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:49.571268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:49.571899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.572178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.572449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.581243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:49.582482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 336/686] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:53:49.583355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:49.596558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:49.597883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:49.599343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 351/687] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:49.609981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51860757-df23-4e67-8edd-9d69f6038df9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:49.714442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51860757-df23-4e67-8edd-9d69f6038df9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:49.750408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:49.751395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.751881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.752382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.753276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:49.753786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:49.755451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:49.770759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 337/688] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:49.779039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:49.786180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:49.867447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:49.886185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775433b-2cf8-4c9d-a16d-6814439239e2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:49.913633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:49.928837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:49.928837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:49.928837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:49.928837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:49.929267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] RBAC: Adding query filter params (role.id=630e4775b76c4761ae25bea28d994b51, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=822b518d691f4c0fa54e2bc41144ff62) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:49.929267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:49.929267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:49.938234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 352/689] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:53:49 2022] GET /identity/v3/role_assignments?user.id=822b518d691f4c0fa54e2bc41144ff62&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=630e4775b76c4761ae25bea28d994b51 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:50.021385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bfcf2-3b85-494b-8d0a-eb7a1720af43 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:50.064790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:50.065443 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:50.065719 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:50.065998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:50.066627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:50.067994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:50.078129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:50.079171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 19:53:50.080077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:50.084383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 338/690] 10.222.0.18 () {56 vars in 1132 bytes} [Sun Oct 23 19:53:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:50.085761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:50.163578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:50.200577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd7424-023b-4bff-a724-5e147e579825 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:50.236991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:50.237606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:50.237886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:50.238188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:50.238825 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:50.239135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:50.240567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:50.250353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 353/691] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:50.253041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:50.355072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:50.362305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a374be-89b3-43f9-b0b3-e61afadc1d7e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:50.397864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a636e5-54d5-4069-84b9-77e00b8a4f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:50.398512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a636e5-54d5-4069-84b9-77e00b8a4f0d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:50.398795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a636e5-54d5-4069-84b9-77e00b8a4f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:50.399075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a636e5-54d5-4069-84b9-77e00b8a4f0d None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:50.399712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a636e5-54d5-4069-84b9-77e00b8a4f0d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:50.400019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a636e5-54d5-4069-84b9-77e00b8a4f0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:50.401380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a636e5-54d5-4069-84b9-77e00b8a4f0d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:50.410385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 339/692] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:50.412927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:50.523982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a24e-fb52-495f-bbc4-92431f8b80eb None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:50.560237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128817ef-5a8f-4880-8315-e25d1f5a709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:50.560853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128817ef-5a8f-4880-8315-e25d1f5a709e None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:50.561133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128817ef-5a8f-4880-8315-e25d1f5a709e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:50.561408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128817ef-5a8f-4880-8315-e25d1f5a709e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:50.562378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128817ef-5a8f-4880-8315-e25d1f5a709e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:50.563823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128817ef-5a8f-4880-8315-e25d1f5a709e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:50.568479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:50.590248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 354/693] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:53:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:51.485068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe121-92a6-4c5c-bfc6-88ca7136c451 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:51.485589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe121-92a6-4c5c-bfc6-88ca7136c451 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:51.485665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe121-92a6-4c5c-bfc6-88ca7136c451 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:51.487193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 340/694] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:51.492623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8100-3930-4c6a-832f-f18337461c0b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:51.493034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8100-3930-4c6a-832f-f18337461c0b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:51.493201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8100-3930-4c6a-832f-f18337461c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:51.513263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c0ad8100-3930-4c6a-832f-f18337461c0b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:51.514510 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c0ad8100-3930-4c6a-832f-f18337461c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:51.592612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 355/695] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:51.729705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e624a-7725-4434-ad0d-acd1ed69ce1d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:51.730367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e624a-7725-4434-ad0d-acd1ed69ce1d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:51.730852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e624a-7725-4434-ad0d-acd1ed69ce1d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:51.732829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 341/696] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:51.738595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc2410-4310-417b-bb8c-8a72bb463b13 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:51.739126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc2410-4310-417b-bb8c-8a72bb463b13 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:51.739602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc2410-4310-417b-bb8c-8a72bb463b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:51.759320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3abc2410-4310-417b-bb8c-8a72bb463b13 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:51.760815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3abc2410-4310-417b-bb8c-8a72bb463b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:51.831627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 356/697] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:51.871178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e624a-7725-4434-ad0d-acd1ed69ce1d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:51.980750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e624a-7725-4434-ad0d-acd1ed69ce1d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.017484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.018038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.018352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.018626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.019222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.020574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:52.029622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:52.030654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:52.031498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 342/698] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:52.036651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc2410-4310-417b-bb8c-8a72bb463b13 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.089082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.106791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.154852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc2410-4310-417b-bb8c-8a72bb463b13 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.186487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.205130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.206918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.207450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.207924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.208750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:52.209703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.211881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.219465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 357/699] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:52.224998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.242724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfeeb-7a72-46ec-89ac-b5a1035a5287 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.289006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277477-fc2f-4fc4-abba-3328289413ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.289881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277477-fc2f-4fc4-abba-3328289413ac None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.290342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277477-fc2f-4fc4-abba-3328289413ac None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.290782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277477-fc2f-4fc4-abba-3328289413ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.291506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277477-fc2f-4fc4-abba-3328289413ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.293011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277477-fc2f-4fc4-abba-3328289413ac None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-57277477-fc2f-4fc4-abba-3328289413ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:52.302838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:52.304089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:52.305046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:52.307127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 343/700] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:52.308521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096fdc-ae0f-45b7-a1c7-17aa20294ac5 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.308955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096fdc-ae0f-45b7-a1c7-17aa20294ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.310000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096fdc-ae0f-45b7-a1c7-17aa20294ac5 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.312043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 344/701] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:52.313896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096fdc-ae0f-45b7-a1c7-17aa20294ac5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.358037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ccdf-5a20-45f1-9a36-674e85b8843e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.373199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.398261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50715f01-ffcc-47a5-bd9a-d5e06223cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.398867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715f01-ffcc-47a5-bd9a-d5e06223cc5d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.399146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715f01-ffcc-47a5-bd9a-d5e06223cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.399420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715f01-ffcc-47a5-bd9a-d5e06223cc5d None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.400048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50715f01-ffcc-47a5-bd9a-d5e06223cc5d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:52.400350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50715f01-ffcc-47a5-bd9a-d5e06223cc5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.401718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50715f01-ffcc-47a5-bd9a-d5e06223cc5d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.407582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 358/702] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:52.409167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533fbf-d47f-4ed2-8900-c0bb63e56641 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.409461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533fbf-d47f-4ed2-8900-c0bb63e56641 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.409740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7533fbf-d47f-4ed2-8900-c0bb63e56641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.415745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.428523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b7533fbf-d47f-4ed2-8900-c0bb63e56641 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:52.429758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b7533fbf-d47f-4ed2-8900-c0bb63e56641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:52.430989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096fdc-ae0f-45b7-a1c7-17aa20294ac5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.470305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.470922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.471200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.471475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.472105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:52.472408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.473760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.485226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 345/703] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:52.485226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.518115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 359/704] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:52.518115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7533fbf-d47f-4ed2-8900-c0bb63e56641 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.600011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4feef7-feeb-4d70-8fa6-f26672fb24ca None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.641950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.642692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.643049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.643398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.644168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] RBAC: Adding query filter params (interface=public, service_id=9eee766ee2714cd89498422c49c72b97, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:52.644569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.645990 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.652723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7533fbf-d47f-4ed2-8900-c0bb63e56641 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.655790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.656909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 346/705] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/endpoints?service_id=9eee766ee2714cd89498422c49c72b97&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:52.657812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.677476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.704100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.704815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.705180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.705524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.706257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:52.706651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.708063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.713843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 360/706] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:52.719610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.792071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f2db-b93f-4c53-a6ec-39b6a4bd772d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.827659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515281-03d5-41f4-bb69-af6a3f9f0ba9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:52.839200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.840157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.840729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.841003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.841817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.843591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.849658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 347/707] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 19:53:52.850435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.866738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623d4d-31de-41eb-8101-f7e46bed95f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:52.867369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623d4d-31de-41eb-8101-f7e46bed95f9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.867649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623d4d-31de-41eb-8101-f7e46bed95f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.867922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623d4d-31de-41eb-8101-f7e46bed95f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.868637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623d4d-31de-41eb-8101-f7e46bed95f9 None admin] RBAC: Adding query filter params (interface=public, service_id=b640aa1d4ee6465e922219e62c3e53bd, region_id=RegionOne) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:52.868952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623d4d-31de-41eb-8101-f7e46bed95f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:52.870387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623d4d-31de-41eb-8101-f7e46bed95f9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:52.876956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 361/708] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/endpoints?service_id=b640aa1d4ee6465e922219e62c3e53bd&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:52.878295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32160-1ac5-45cf-8a66-9ebe08bf4656 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:52.878581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32160-1ac5-45cf-8a66-9ebe08bf4656 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:52.878854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32160-1ac5-45cf-8a66-9ebe08bf4656 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:52.880371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 362/709] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:52.884561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32160-1ac5-45cf-8a66-9ebe08bf4656 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:52.920265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.953684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:52.976573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1217d-93e0-4df6-af6e-7df405f22c62 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:53.001822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32160-1ac5-45cf-8a66-9ebe08bf4656 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:53.015585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048d0f9-e982-4d1b-b778-3e9e8f1c6e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:53.016226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048d0f9-e982-4d1b-b778-3e9e8f1c6e08 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.016504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048d0f9-e982-4d1b-b778-3e9e8f1c6e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.016789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048d0f9-e982-4d1b-b778-3e9e8f1c6e08 None admin] PATH_INFO: `/v3/services/image` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.017599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048d0f9-e982-4d1b-b778-3e9e8f1c6e08 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:53.018766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048d0f9-e982-4d1b-b778-3e9e8f1c6e08 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d048d0f9-e982-4d1b-b778-3e9e8f1c6e08 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:53.028402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:53.029615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:53.030742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 348/710] 10.222.0.18 () {56 vars in 1105 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:53.031729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87aac9-bf3b-4fac-8d67-f2783d928993 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.031729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87aac9-bf3b-4fac-8d67-f2783d928993 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.031729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87aac9-bf3b-4fac-8d67-f2783d928993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.047056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:53.047723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.048014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.048286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.049548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:53.050283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:53.050666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7a87aac9-bf3b-4fac-8d67-f2783d928993 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:53.051855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7a87aac9-bf3b-4fac-8d67-f2783d928993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:53.056930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 363/711] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:53:52 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 19:53:53.057743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:53.158598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 349/712] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:53.177946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:53.186726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbed609-75b9-46a1-bcc7-d68d70499863 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:53.226608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:53.227287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.227569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.227893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.228525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] RBAC: Adding query filter params (name=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:53.228823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:53.230202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:53.236149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 364/713] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:53.241738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87aac9-bf3b-4fac-8d67-f2783d928993 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:53.322251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:53.348758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87aac9-bf3b-4fac-8d67-f2783d928993 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:53.384007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:53.384620 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.384899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.385172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.385805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] RBAC: Adding query filter params (type=image) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:53.386128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:53.387702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:53.392789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 350/714] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:53.448538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:53.564580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581c690-ac78-4d37-a6af-6bd04cf22180 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:53.605679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:53.609486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.609486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.609486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.609486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:53.609486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:53.622982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:53.624367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:53.625445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 365/715] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:53.630317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:53.735282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c46eec-440d-4cf7-aa3a-f7ebe1293381 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:53.770923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaedbb-e8a0-40cc-a6d8-d085255d6d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:53.771539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaedbb-e8a0-40cc-a6d8-d085255d6d0f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.771824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaedbb-e8a0-40cc-a6d8-d085255d6d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.772101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaedbb-e8a0-40cc-a6d8-d085255d6d0f None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.772743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaedbb-e8a0-40cc-a6d8-d085255d6d0f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:53.773051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaedbb-e8a0-40cc-a6d8-d085255d6d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:53.774478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaedbb-e8a0-40cc-a6d8-d085255d6d0f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:53.780447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 351/716] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:53.786094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:53.814285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:53.893325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d2294-9306-47cf-abb1-28693c6729b7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:53.930180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30743dbf-f09a-4fd0-bda9-5e44e22cb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:53.931120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743dbf-f09a-4fd0-bda9-5e44e22cb80f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:53.931594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743dbf-f09a-4fd0-bda9-5e44e22cb80f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:53.932092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743dbf-f09a-4fd0-bda9-5e44e22cb80f None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:53.932912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30743dbf-f09a-4fd0-bda9-5e44e22cb80f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:53.933407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30743dbf-f09a-4fd0-bda9-5e44e22cb80f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:53.935004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30743dbf-f09a-4fd0-bda9-5e44e22cb80f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:53.940608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 366/717] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:55.123742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268b42-4ba9-4d9f-80a3-acb297599f51 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.124863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268b42-4ba9-4d9f-80a3-acb297599f51 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.125345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268b42-4ba9-4d9f-80a3-acb297599f51 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.127176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 352/718] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:55.132764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232d500-1811-46d8-8eeb-4ae27deb38ce None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.133562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232d500-1811-46d8-8eeb-4ae27deb38ce None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.134031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232d500-1811-46d8-8eeb-4ae27deb38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.153503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2232d500-1811-46d8-8eeb-4ae27deb38ce None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:55.155053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2232d500-1811-46d8-8eeb-4ae27deb38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:55.238183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 367/719] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:55.299476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ccb50-4147-4409-837b-37e582e8a6ff None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.299794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ccb50-4147-4409-837b-37e582e8a6ff None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.300032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ccb50-4147-4409-837b-37e582e8a6ff None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.301483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 353/720] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:55.306867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c2bd-01d1-4062-9146-1e9f468682c2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.307408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c2bd-01d1-4062-9146-1e9f468682c2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.307889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c2bd-01d1-4062-9146-1e9f468682c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.328218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-41d5c2bd-01d1-4062-9146-1e9f468682c2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:55.329747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-41d5c2bd-01d1-4062-9146-1e9f468682c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:55.344324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:55.402041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 368/721] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:55.531580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ccb50-4147-4409-837b-37e582e8a6ff None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:55.534639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:55.651861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ccb50-4147-4409-837b-37e582e8a6ff None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:55.670511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6c557-036d-44bc-a4ae-d5105c421fda None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.671119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6c557-036d-44bc-a4ae-d5105c421fda None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.671616 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6c557-036d-44bc-a4ae-d5105c421fda None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.673392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 369/722] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:55.679330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896766-346b-4e10-bc02-7bff2a5986f5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.680213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896766-346b-4e10-bc02-7bff2a5986f5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.681006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896766-346b-4e10-bc02-7bff2a5986f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.692788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:55.693707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.694233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.694710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.695515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:55.697206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:55.702904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d8896766-346b-4e10-bc02-7bff2a5986f5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:55.704437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d8896766-346b-4e10-bc02-7bff2a5986f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:55.706848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:55.707826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:55.708980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 354/723] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:55.709932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:55.778823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:55.784128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 370/724] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:55.785292 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896766-346b-4e10-bc02-7bff2a5986f5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:55.824003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4441ac-687d-4aec-8eac-45c5e82ed3a0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:55.866691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:55.868152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.868669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.869679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:55.871080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.872235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:55.875577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:55.888160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:55.889190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:55.890052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:55.893563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 355/725] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:55.899794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:55.903776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896766-346b-4e10-bc02-7bff2a5986f5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:55.953644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:55.954534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:55.954869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:55.955150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:55.956271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:55.956753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:55.958865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:55.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 371/726] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:55.971786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:56.035892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e96d10-635f-4eba-a043-e8327cc29935 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:56.071086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:56.078273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:56.078876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.079150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.079420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.080041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:56.080347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:56.081690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:56.086541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 356/727] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:53:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:56.092338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:56.107189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc641c-c842-4345-a23d-8858addb28dc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:56.142987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:56.143605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.143858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.144131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.144760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:56.145063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:56.146446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:56.156282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 372/728] 10.222.0.18 () {56 vars in 1114 bytes} [Sun Oct 23 19:53:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:53:56.156282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:56.160481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:56.200956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec6a2-5432-447a-9b45-9e25f8e6da03 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:56.235149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009041bb-70a6-4967-ae90-cf9d2b130339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:56.235682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009041bb-70a6-4967-ae90-cf9d2b130339 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.235966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009041bb-70a6-4967-ae90-cf9d2b130339 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.236243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009041bb-70a6-4967-ae90-cf9d2b130339 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.236894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009041bb-70a6-4967-ae90-cf9d2b130339 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:56.238284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009041bb-70a6-4967-ae90-cf9d2b130339 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:56.252177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2064bf-acb7-4975-a68c-afafdd54645a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:56.252764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 357/729] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:53:56 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:56.253961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf39c5-75cd-47d3-8d52-10710c0a048e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.254280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf39c5-75cd-47d3-8d52-10710c0a048e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.254564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf39c5-75cd-47d3-8d52-10710c0a048e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.258156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 358/730] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:56.258156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf39c5-75cd-47d3-8d52-10710c0a048e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:56.303233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f486c0-565d-4e1d-aef5-66807915a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:56.303974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f486c0-565d-4e1d-aef5-66807915a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.304290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f486c0-565d-4e1d-aef5-66807915a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.304570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f486c0-565d-4e1d-aef5-66807915a2e9 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.305220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f486c0-565d-4e1d-aef5-66807915a2e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:56.305539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f486c0-565d-4e1d-aef5-66807915a2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:56.306984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f486c0-565d-4e1d-aef5-66807915a2e9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:56.313890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 373/731] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:53:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:56.319760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10538b7-5f00-4ea8-91f6-ce658e28aa73 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.320041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10538b7-5f00-4ea8-91f6-ce658e28aa73 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.320317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10538b7-5f00-4ea8-91f6-ce658e28aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.331250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:56.340584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d10538b7-5f00-4ea8-91f6-ce658e28aa73 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:56.341865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d10538b7-5f00-4ea8-91f6-ce658e28aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:56.386522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf39c5-75cd-47d3-8d52-10710c0a048e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:56.407125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:56.415035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 374/732] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:56.415884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10538b7-5f00-4ea8-91f6-ce658e28aa73 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:56.440549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:56.441281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.441627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.441906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.442663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:56.444020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:56.472672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 359/733] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:53:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:56.551900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10538b7-5f00-4ea8-91f6-ce658e28aa73 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:56.597070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a5136-04b3-449c-942a-58c4c846dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:56.597734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5136-04b3-449c-942a-58c4c846dc36 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.598016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5136-04b3-449c-942a-58c4c846dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.598314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5136-04b3-449c-942a-58c4c846dc36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.598984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a5136-04b3-449c-942a-58c4c846dc36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:56.612182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a5136-04b3-449c-942a-58c4c846dc36 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:56.636424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 375/734] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:53:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:56.706554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:56.825682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac00cd-9063-4c03-9f85-8d0092cdd4f9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:56.836976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:56.876550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac474e08-2408-4bf2-bd4d-0e83f9419270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:56.877165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474e08-2408-4bf2-bd4d-0e83f9419270 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:56.877444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474e08-2408-4bf2-bd4d-0e83f9419270 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:56.877715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474e08-2408-4bf2-bd4d-0e83f9419270 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:56.878420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac474e08-2408-4bf2-bd4d-0e83f9419270 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:56.879779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac474e08-2408-4bf2-bd4d-0e83f9419270 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:56.898680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 360/735] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:53:56 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:53:58.577957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dbcb6-f3a8-4fa2-86e3-77a13d19ae35 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:58.578511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dbcb6-f3a8-4fa2-86e3-77a13d19ae35 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:58.578511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dbcb6-f3a8-4fa2-86e3-77a13d19ae35 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:58.580136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 376/736] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:58.585294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41e79-a350-4213-a968-34a5ba1d32b5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:58.585678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41e79-a350-4213-a968-34a5ba1d32b5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:58.585858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41e79-a350-4213-a968-34a5ba1d32b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:58.610682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cdf41e79-a350-4213-a968-34a5ba1d32b5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:58.611898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cdf41e79-a350-4213-a968-34a5ba1d32b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:58.692615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 361/737] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:58.764639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84e781-699a-4bd7-a04b-b7fdfefe8164 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:58.764994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84e781-699a-4bd7-a04b-b7fdfefe8164 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:58.765197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84e781-699a-4bd7-a04b-b7fdfefe8164 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:58.766812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 377/738] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:58.771994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55163bf-ad77-49e8-bcc3-49017b29d58f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:58.772290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55163bf-ad77-49e8-bcc3-49017b29d58f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:58.772569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55163bf-ad77-49e8-bcc3-49017b29d58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:58.791968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d55163bf-ad77-49e8-bcc3-49017b29d58f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:58.793201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d55163bf-ad77-49e8-bcc3-49017b29d58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:58.867921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 362/739] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:58.924859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881badfc-72f2-40da-872d-615c2c683d30 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:58.925183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881badfc-72f2-40da-872d-615c2c683d30 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:58.925425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881badfc-72f2-40da-872d-615c2c683d30 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:58.927031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 378/740] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:53:58.932554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d4d8-5ca6-48bd-b006-339636621e32 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:58.932847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d4d8-5ca6-48bd-b006-339636621e32 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:58.933128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9d4d8-5ca6-48bd-b006-339636621e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:58.952133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-40b9d4d8-5ca6-48bd-b006-339636621e32 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:58.953317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-40b9d4d8-5ca6-48bd-b006-339636621e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:58.966516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881badfc-72f2-40da-872d-615c2c683d30 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:58.971234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.026376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.040691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 363/741] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:59.086656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881badfc-72f2-40da-872d-615c2c683d30 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.122423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67b42-6e83-43ff-95b7-36de7e89d24f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.122699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67b42-6e83-43ff-95b7-36de7e89d24f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.122948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d67b42-6e83-43ff-95b7-36de7e89d24f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.125379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.126007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.126327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.126599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] PATH_INFO: `/v3/services/image` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.127185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.128534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 364/742] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:53:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:53:59.128663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.129635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e22f0-fb76-4df9-8628-a535103e6420 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.129921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e22f0-fb76-4df9-8628-a535103e6420 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.130333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e22f0-fb76-4df9-8628-a535103e6420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:59.139123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:59.140181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:59.141021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 379/743] 10.222.0.18 () {56 vars in 1105 bytes} [Sun Oct 23 19:53:58 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:53:59.147842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.150999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-253e22f0-fb76-4df9-8628-a535103e6420 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:53:59.154316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-253e22f0-fb76-4df9-8628-a535103e6420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:53:59.228552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 365/744] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:53:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:53:59.229371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e22f0-fb76-4df9-8628-a535103e6420 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.268705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5e00-c151-4472-9368-abce6b6d1a59 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.286664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.311124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.311708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.312255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.312524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.313163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:59.313903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.314968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.320524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 380/745] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:59.327178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.332643 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.354402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e22f0-fb76-4df9-8628-a535103e6420 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.395229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.395761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.396041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.396311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.396948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.399539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.402147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING keystone.server.flask.common [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 23 19:53:59.423311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.sql.core [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 19:53:59.423311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 19:53:59.423311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [parameters: {'id': '31f5b4a1c32a42fda8805d90bb4bbbc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 19:53:59.423311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 19:53:59.428545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d371e3-834d-41bb-9b1b-b9e16e33eec1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31f5b4a1c32a42fda8805d90bb4bbbc3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31f5b4a1c32a42fda8805d90bb4bbbc3. Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:53:59.430739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 19:53:59.431550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application yield resource Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise self.value Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application session.commit() Oct 23 19:53:59.432563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.flush() Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application compat.raise_( Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 19:53:59.433444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 19:53:59.434504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:53:59.435404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [parameters: {'id': '31f5b4a1c32a42fda8805d90bb4bbbc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.436295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:59.440794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31f5b4a1c32a42fda8805d90bb4bbbc3. Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 366/746] 10.222.0.18 () {60 vars in 1140 bytes} [Sun Oct 23 19:53:59 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:59.443311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.471521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.472243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.472623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.472990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.473730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] RBAC: Adding query filter params (type=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:59.474159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.475509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.480521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 381/747] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:59.481759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.533130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.546391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30fcb8-4ffe-431b-8f15-7aed3f1d06cb None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.579824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.580446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.580724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.580996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.581572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.583145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.591731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164dede-7346-493d-9fba-42851d3ce240 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:59.592624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:59.593880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:53:59.594795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 367/748] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:59.596034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.597535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.630995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.631612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.631900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.632172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.639532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.640960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:53:59.652489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:59.653984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:59.654935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 382/749] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:59.655586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.703780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e597c-df94-4a8c-8a51-7e16ce35badb None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.738487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.739079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.739355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.739623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.740307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] RBAC: Adding query filter params (interface=public, service_id=c1c593ebe77d4c81862c23ab65975ec1, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:59.740613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.741997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.750132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.750693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 368/750] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/endpoints?service_id=c1c593ebe77d4c81862c23ab65975ec1&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:59.751553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.753381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db1eed-7c88-414e-b651-f633d0d93e81 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.787481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.788102 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.788382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.788652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.789226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.790629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:53:59.799204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:53:59.800202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:53:59.801056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 383/751] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:53:59.801860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.825382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:53:59.860716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fd304-f007-4fd6-a87a-23323d9b5c40 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.893217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.893813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.894107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.894386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.895003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:59.895301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.896645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.898993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd2968-5c44-4bf9-8809-44b24b20167d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:53:59.901320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 369/752] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:59.902116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.934683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:53:59.935316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:53:59.935597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:53:59.935865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:53:59.936527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:53:59.936823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:53:59.938526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:53:59.954845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 384/753] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:53:59.955640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:53:59.982808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:00.024848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5cad6-ba71-474f-b9a2-949bd77173f5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.057228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:00.065845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.066104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78d430-c26f-4ed5-8c60-ea824301e2c2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.066654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.067007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.067355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.068043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.069500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.081105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 370/754] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/services => generated 1957 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 19:54:00.082759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:00.112713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.113584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.113969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.114405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.115174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:00.115581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.117428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.128400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 385/755] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:53:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:00.132634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:00.233954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b267700-6535-4a60-b67c-a522c4a82efe None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.270585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:00.276388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.277006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.277290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.277698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.278534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:00.278847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.280275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.284152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af3b22-15dc-4963-8b61-b2eb3d05eca9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.286199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 371/756] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:54:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:00.293184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:00.327300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.327909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.328312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.328461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.329100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:00.329463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.330939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.336216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 386/757] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:54:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:00.343337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:00.378265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:00.437630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380f94d-6eab-4594-a0b7-5e92ca5dca9b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.455924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e996ef2-9b6c-49e5-bf53-d4e31e9b6213 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.475021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.475975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.476516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.477007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.477983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] RBAC: Adding query filter params (interface=admin, service_id=b640aa1d4ee6465e922219e62c3e53bd, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:00.478522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.480071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.486240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 372/758] 10.222.0.18 () {56 vars in 1249 bytes} [Sun Oct 23 19:54:00 2022] GET /identity/v3/endpoints?service_id=b640aa1d4ee6465e922219e62c3e53bd&interface=admin®ion_id=RegionOne => generated 193 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:00.492281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:00.502785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.503531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.503912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.504707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.505523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] RBAC: Adding query filter params (interface=public, service_id=6a9e3bc953384aba8447d99183dbffd7, region_id=RegionOne) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:00.505988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.507931 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.520827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 387/759] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:54:00 2022] GET /identity/v3/endpoints?service_id=6a9e3bc953384aba8447d99183dbffd7&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:00.523061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:00.546533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:00.628806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6b9f9-6073-40e9-bf10-923a1033178d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.661281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:00.664868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591d0d6-9f7d-41e2-ab8b-0734d6624182 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:00.674966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45ff5c-2dee-44cb-a91e-cde1ec213bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.675694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ff5c-2dee-44cb-a91e-cde1ec213bee None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.676074 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ff5c-2dee-44cb-a91e-cde1ec213bee None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.676447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ff5c-2dee-44cb-a91e-cde1ec213bee None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.677150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45ff5c-2dee-44cb-a91e-cde1ec213bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.678662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45ff5c-2dee-44cb-a91e-cde1ec213bee None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.690488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 373/760] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:54:00 2022] GET /identity/v3/services => generated 1957 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 19:54:00.706572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4331b02-2030-483a-9bc8-dd6b89fcf80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:00.707463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4331b02-2030-483a-9bc8-dd6b89fcf80c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:00.707897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4331b02-2030-483a-9bc8-dd6b89fcf80c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:00.708317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4331b02-2030-483a-9bc8-dd6b89fcf80c None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:00.709120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4331b02-2030-483a-9bc8-dd6b89fcf80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:00.710749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4331b02-2030-483a-9bc8-dd6b89fcf80c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:00.726265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 388/761] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:54:00 2022] GET /identity/v3/services => generated 1957 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 19:54:02.272044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee0cad-da1c-4953-964a-52c3fce10d0b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:02.272628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee0cad-da1c-4953-964a-52c3fce10d0b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:02.272628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee0cad-da1c-4953-964a-52c3fce10d0b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:02.274016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 374/762] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:02.280349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02b23-9f5c-42ed-a98e-1575cbf7a693 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:02.280869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02b23-9f5c-42ed-a98e-1575cbf7a693 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:02.280869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f02b23-9f5c-42ed-a98e-1575cbf7a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:02.301329 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-17f02b23-9f5c-42ed-a98e-1575cbf7a693 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:02.302557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17f02b23-9f5c-42ed-a98e-1575cbf7a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:02.374675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 389/763] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:02 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:54:02.381665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b9be4-3ce8-47cc-8b78-7d1943f9aaa3 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:02.381958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b9be4-3ce8-47cc-8b78-7d1943f9aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:02.382276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b9be4-3ce8-47cc-8b78-7d1943f9aaa3 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:02.383852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 375/764] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:02.389009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9839f-79c9-4bb6-8481-7d66f8ba5bd6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:02.389302 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9839f-79c9-4bb6-8481-7d66f8ba5bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:02.389579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9839f-79c9-4bb6-8481-7d66f8ba5bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:02.407889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-76f9839f-79c9-4bb6-8481-7d66f8ba5bd6 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:02.409071 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-76f9839f-79c9-4bb6-8481-7d66f8ba5bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:02.412801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:02.486200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 390/765] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:02 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:02.661575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b9be4-3ce8-47cc-8b78-7d1943f9aaa3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:02.762736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9839f-79c9-4bb6-8481-7d66f8ba5bd6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:02.766748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b9be4-3ce8-47cc-8b78-7d1943f9aaa3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:02.802506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:02.803116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:02.803400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:02.803676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:02.804337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:02.805764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:02.822007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.sql.core [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 19:54:02.822007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 19:54:02.822007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [parameters: {'user_id': '0e558c7926db42a8bd23798ee47b85f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 19:54:02.822007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:54:02.829846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:54:02.830980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application yield resource Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise self.value Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application session.commit() Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 19:54:02.831930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.flush() Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application compat.raise_( Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 19:54:02.832803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:54:02.833679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:54:02.841221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [parameters: {'user_id': '0e558c7926db42a8bd23798ee47b85f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:02.842059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 23 19:54:02.842885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 376/766] 10.222.0.18 () {60 vars in 1131 bytes} [Sun Oct 23 19:54:02 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:02.845200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:02.896025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9839f-79c9-4bb6-8481-7d66f8ba5bd6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:02.904576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:02.950796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4029b-622f-4d2a-885a-8c8e9ae949a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:02.951878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4029b-622f-4d2a-885a-8c8e9ae949a1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:02.952397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4029b-622f-4d2a-885a-8c8e9ae949a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:02.953435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4029b-622f-4d2a-885a-8c8e9ae949a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:02.954516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4029b-622f-4d2a-885a-8c8e9ae949a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:02.956786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4029b-622f-4d2a-885a-8c8e9ae949a1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:02.966242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61e15e-1b13-413d-bf4d-52095b0766c3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2fc4029b-622f-4d2a-885a-8c8e9ae949a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:02.970758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:02.971742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 19:54:02.972580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:02.973315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 391/767] 10.222.0.18 () {56 vars in 1105 bytes} [Sun Oct 23 19:54:02 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:02.973847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219947-d868-4d41-92e8-81be8526cc59 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:02.974415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219947-d868-4d41-92e8-81be8526cc59 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:02.974699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219947-d868-4d41-92e8-81be8526cc59 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:02.976046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 392/768] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:02.980710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4219947-d868-4d41-92e8-81be8526cc59 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:02.985040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:03.007364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ae3cd-3d97-4732-b238-0d2568696a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.008086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae3cd-3d97-4732-b238-0d2568696a3e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.008434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae3cd-3d97-4732-b238-0d2568696a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.008716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ae3cd-3d97-4732-b238-0d2568696a3e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.017331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ae3cd-3d97-4732-b238-0d2568696a3e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.018785 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ae3cd-3d97-4732-b238-0d2568696a3e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-6a4ae3cd-3d97-4732-b238-0d2568696a3e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:54:03.030704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:03.031810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:03.033249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 377/769] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:54:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:03.035416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6a6a-d255-47ab-a535-02f74198ef80 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.035700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6a6a-d255-47ab-a535-02f74198ef80 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.035973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6a6a-d255-47ab-a535-02f74198ef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.053647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ee6c6a6a-d255-47ab-a535-02f74198ef80 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:03.055192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ee6c6a6a-d255-47ab-a535-02f74198ef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:03.088656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4219947-d868-4d41-92e8-81be8526cc59 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.120834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 378/770] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:03.122157 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbad05-97bb-4a28-bef0-fae4e1f11df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.122286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1cad-6e65-4719-8751-067b4bfba7a6 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.122493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1cad-6e65-4719-8751-067b4bfba7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.122597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbad05-97bb-4a28-bef0-fae4e1f11df7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.122683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1cad-6e65-4719-8751-067b4bfba7a6 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.122776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbad05-97bb-4a28-bef0-fae4e1f11df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.123038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbad05-97bb-4a28-bef0-fae4e1f11df7 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.123665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbad05-97bb-4a28-bef0-fae4e1f11df7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:03.123967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbad05-97bb-4a28-bef0-fae4e1f11df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.125321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbad05-97bb-4a28-bef0-fae4e1f11df7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.126514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 379/771] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:03.127220 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1cad-6e65-4719-8751-067b4bfba7a6 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.140334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 393/772] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:03.140334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47621b-ec50-44d1-9904-93bbd4f3c8b0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.140334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47621b-ec50-44d1-9904-93bbd4f3c8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.140334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47621b-ec50-44d1-9904-93bbd4f3c8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.156367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bd47621b-ec50-44d1-9904-93bbd4f3c8b0 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:03.157481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bd47621b-ec50-44d1-9904-93bbd4f3c8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:03.175863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:03.223819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:03.230394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 394/773] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:03.231214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47621b-ec50-44d1-9904-93bbd4f3c8b0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.260098 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1cad-6e65-4719-8751-067b4bfba7a6 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.314110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.314738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.315001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.315276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.316038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:03.316286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.317704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.346564 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47621b-ec50-44d1-9904-93bbd4f3c8b0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.354522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 380/774] 10.222.0.18 () {56 vars in 1101 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:03.393475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.394482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.394906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.395323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.396133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] RBAC: Adding query filter params (type=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:03.396578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.398235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.399421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.410341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 395/775] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:03.415762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.493899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:03.508636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:03.517114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c97dc-e7a7-48ba-8d0d-921aac0b314b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.548448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139fde9-f32d-4f91-b7e6-13fdd5761665 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.565190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.566163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.566163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.566431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.567022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.568370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:03.579456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:03.580464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:03.581342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 381/776] 10.222.0.18 () {56 vars in 1126 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:03.582210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.589056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.589542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.589823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.590131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.591325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.592817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.623228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 396/777] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:54:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:03.624114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.712851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4904409-e32c-410c-998c-bd53437ee212 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.751910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23fcc6-f74d-459b-ac90-45f2dd796344 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.760016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.760950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.761234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.761508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.762638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.764368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.768048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:03.773971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:03.778412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:03.779289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 382/778] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:03.781437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.798912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.799778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.799778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.800064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.800698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:03.801103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.802406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.807169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:03.807698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 397/779] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:03.814602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.897608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93208b-8d17-4611-b694-e9b9cafb026c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.925584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae3a6-f370-4205-aeb1-909ed06ad0f2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:03.934294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.935086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.935377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.935656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.936449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:03.936758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.938505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.948361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 383/780] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:03.949347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:03.970270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:03.971419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:03.971884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:03.972346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:03.973150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:03.974029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:03.976054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:03.984106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 398/781] 10.222.0.18 () {56 vars in 1122 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:03.989405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:04.037202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:04.040328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:04.058164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8609e4-b540-46a9-8c71-39a7217ed310 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:04.095874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:04.096802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:04.097234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:04.097514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:04.098179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:04.098491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:04.098957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665a75-57ae-4c8f-a8bd-05ef366ca039 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:04.099909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:04.110985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 384/782] 10.222.0.18 () {56 vars in 1112 bytes} [Sun Oct 23 19:54:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:04.112032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:04.135159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a4720-8b20-4e8a-aaa8-47697fa934ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:04.135751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4720-8b20-4e8a-aaa8-47697fa934ab None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:04.136479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4720-8b20-4e8a-aaa8-47697fa934ab None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:04.136760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4720-8b20-4e8a-aaa8-47697fa934ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:04.138172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a4720-8b20-4e8a-aaa8-47697fa934ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:04.139484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a4720-8b20-4e8a-aaa8-47697fa934ab None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:04.166794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 399/783] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:54:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:04.228785 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61444-0d38-4ab5-947b-9992cda31616 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:04.274540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ce92d-a346-4543-8eee-fb92cdb457d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:04.275353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce92d-a346-4543-8eee-fb92cdb457d0 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:04.275733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce92d-a346-4543-8eee-fb92cdb457d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:04.276106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce92d-a346-4543-8eee-fb92cdb457d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:04.276877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ce92d-a346-4543-8eee-fb92cdb457d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:04.278617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ce92d-a346-4543-8eee-fb92cdb457d0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:04.295677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:04.303813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 385/784] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:54:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:05.848167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e57ac-e8cd-44c7-8ade-90febc6c3a7b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:05.848678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e57ac-e8cd-44c7-8ade-90febc6c3a7b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:05.848755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e57ac-e8cd-44c7-8ade-90febc6c3a7b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:05.850233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 400/785] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:05.855360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b2633-6952-4731-9a90-6179963390e6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:05.855856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b2633-6952-4731-9a90-6179963390e6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:05.855996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b2633-6952-4731-9a90-6179963390e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:05.874694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-815b2633-6952-4731-9a90-6179963390e6 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:05.875896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-815b2633-6952-4731-9a90-6179963390e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:05.950260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 386/786] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:06.217991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e57ac-e8cd-44c7-8ade-90febc6c3a7b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:06.325751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e57ac-e8cd-44c7-8ade-90febc6c3a7b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:06.327325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:06.354546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3cb30-d1c8-4166-afae-911b46e33bea None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.354838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3cb30-d1c8-4166-afae-911b46e33bea None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.355107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3cb30-d1c8-4166-afae-911b46e33bea None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.357308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 387/787] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:54:06.362147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7f3a-48ad-42d9-bfde-f7bbe267547c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.362442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7f3a-48ad-42d9-bfde-f7bbe267547c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.362723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7f3a-48ad-42d9-bfde-f7bbe267547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.363605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:06.364205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.364484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.364757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.365420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:06.366797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:06.376015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.sql.core [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 19:54:06.376015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 19:54:06.376015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [parameters: {'id': '70b91d0ce2c345ceafd398698158586b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 19:54:06.376015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81391) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 19:54:06.381100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3add7f3a-48ad-42d9-bfde-f7bbe267547c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:06.382324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3add7f3a-48ad-42d9-bfde-f7bbe267547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:54:06.392550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result.read() Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 19:54:06.393440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application yield resource Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application next(self.gen) Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise self.value Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application session.commit() Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 19:54:06.394425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.session.flush() Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application compat.raise_( Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 19:54:06.395339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 19:54:06.396222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application conn.query(q) Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result.read() Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 19:54:06.397004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [parameters: {'id': '70b91d0ce2c345ceafd398698158586b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 19:54:06.397902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:06.400113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 401/788] 10.222.0.18 () {60 vars in 1137 bytes} [Sun Oct 23 19:54:06 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:06.402256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:06.459869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 388/789] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:54:06.515720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5709c-92e5-4eb2-b601-fe7db3bb931a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:06.549101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:06.549717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.549993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.550289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.561303 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:06.563016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:06.575092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d609-4c1c-49c7-a0b3-8c4cd9e43c5d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.575467 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d609-4c1c-49c7-a0b3-8c4cd9e43c5d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.575750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d609-4c1c-49c7-a0b3-8c4cd9e43c5d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.577260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 389/790] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:54:06.577933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:06.578872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:54:06.579770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:54:06.579770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:06.579770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:06.579770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 402/791] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:06.582233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008cfc-ea42-4bee-8b2e-26af858082f9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.582547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008cfc-ea42-4bee-8b2e-26af858082f9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.582859 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73008cfc-ea42-4bee-8b2e-26af858082f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.586137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:06.602753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-73008cfc-ea42-4bee-8b2e-26af858082f9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:06.603960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-73008cfc-ea42-4bee-8b2e-26af858082f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:06.617990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:06.659584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:06.678044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 390/792] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:54:06.709547 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f493df4-89ab-4056-9e44-9c84e881cd77 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:06.738493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73008cfc-ea42-4bee-8b2e-26af858082f9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:06.745674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:06.746678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.747187 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.747679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.748526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:06.749124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:06.750621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:06.766331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 403/793] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:06.845902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73008cfc-ea42-4bee-8b2e-26af858082f9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:06.885479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:06.886238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:06.886504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:06.886675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:06.888546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:06.890004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:06.891846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 391/794] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:06.897736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:06.946131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:06.984495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:07.010605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efcad1-f598-4bf0-bfcd-f275b3d998f4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:07.015474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:07.048909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:07.049442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:07.049730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:07.050009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:07.050706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:07.052137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:07.064151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89c57-8076-4c81-9a08-738cbaf4e350 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:07.082790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 404/795] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:54:06 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:54:07.101360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:07.102070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:07.102397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:07.102698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:07.117378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:07.122733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:07.123989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:07.124984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 392/796] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Oct 23 19:54:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:54:07.130266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:07.238251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf534-c543-4c0f-882e-2cbbb3643a35 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:07.268551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:07.276453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:07.277060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:07.277340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:07.277678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:07.278360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:07.278667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:07.280030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:07.288705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 405/797] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Oct 23 19:54:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:07.294604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:07.396710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14134e4a-bb92-46cc-be92-aceb2d44ef33 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:07.410921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:07.431552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:07.432176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:07.432458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:07.432732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:07.443052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:07.444478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:54:07.458860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:07.460014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:54:07.461255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:54:07.461255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:07.461255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:07.461255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 393/798] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:07.466550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:07.565214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475b971-0020-4cc3-89e0-d4c5338913e0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:07.598280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:07.598888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:07.599169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:07.599441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:07.600090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:07.600394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:07.601770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:07.615579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 406/799] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:07.621246 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:07.720231 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69054e26-2374-400e-85af-8a787ce90c55 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:07.753996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:07.754646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:07.754930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:07.755207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:07.762574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:07.764002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:54:07.774915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:07.775987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:07.776923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 394/800] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Oct 23 19:54:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:54:07.782147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:07.834765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:07.881786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd772a-a143-451e-811e-2130a594d761 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:07.914174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:07.914783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:07.915027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:07.915294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:07.916010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:07.916311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:07.917716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:07.935151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 407/801] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Oct 23 19:54:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:07.941565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:07.969471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:08.042647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aedee6-32d9-4eaa-ad6e-d1603d5c1761 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:08.076024 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:08.076641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:08.076925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:08.077202 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:08.087317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:08.088745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:54:08.102567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:08.103757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:54:08.104842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:54:08.104842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:08.104842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:08.106267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 395/802] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:08.109663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:08.208468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b04914-f606-49d8-9f8b-94aa440bdfaf None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:08.218849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:08.242402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:08.243057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:08.243362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:08.243604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:08.244320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:08.244661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:08.246007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:08.257895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 408/803] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:08.264573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:08.341840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:08.363588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe05a84-441f-4ff1-8c6a-30a854d7cb2a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:08.396358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:08.396980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:08.397264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:08.397547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:08.404651 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:08.406073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:54:08.417049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:08.418114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:08.424133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 396/804] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:08.426049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:08.522744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d041ee-3848-4d05-b3d5-dc9d34285b72 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:08.554998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638318-8636-4bc9-8dd2-b74e4582bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:08.555584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638318-8636-4bc9-8dd2-b74e4582bf88 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:08.555861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638318-8636-4bc9-8dd2-b74e4582bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:08.556129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638318-8636-4bc9-8dd2-b74e4582bf88 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:08.556800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638318-8636-4bc9-8dd2-b74e4582bf88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:08.557102 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638318-8636-4bc9-8dd2-b74e4582bf88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:08.558544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638318-8636-4bc9-8dd2-b74e4582bf88 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:08.570318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 409/805] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:08.576736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:08.679478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0673-b32d-40dc-86ff-91dbf0038fae None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:08.712222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807db28-b7ca-4a96-a2e2-53597ffbe137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:08.712856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807db28-b7ca-4a96-a2e2-53597ffbe137 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:08.713131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807db28-b7ca-4a96-a2e2-53597ffbe137 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:08.713400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807db28-b7ca-4a96-a2e2-53597ffbe137 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/155cc268d5ef4e47bb7a16093a360ba7/roles/630e4775b76c4761ae25bea28d994b51` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:08.715790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807db28-b7ca-4a96-a2e2-53597ffbe137 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=155cc268d5ef4e47bb7a16093a360ba7, role_id=630e4775b76c4761ae25bea28d994b51)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:08.717207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807db28-b7ca-4a96-a2e2-53597ffbe137 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:08.724919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:08.730437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 397/806] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:54:08 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/155cc268d5ef4e47bb7a16093a360ba7/roles/630e4775b76c4761ae25bea28d994b51 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:54:09.285888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db99d-0819-44e4-a3de-55a656042604 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:09.286472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db99d-0819-44e4-a3de-55a656042604 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:09.286472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db99d-0819-44e4-a3de-55a656042604 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:09.287809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 410/807] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:09.293147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99f0f-5454-49b4-b7c4-ddb6a4337eb8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:09.294249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99f0f-5454-49b4-b7c4-ddb6a4337eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:09.294341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99f0f-5454-49b4-b7c4-ddb6a4337eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:09.312777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cda99f0f-5454-49b4-b7c4-ddb6a4337eb8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:09.313951 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cda99f0f-5454-49b4-b7c4-ddb6a4337eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:09.378760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 398/808] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:09.649903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878db99d-0819-44e4-a3de-55a656042604 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:09.681011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:09.750959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878db99d-0819-44e4-a3de-55a656042604 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:09.783447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc4ef-c7bc-4530-8011-f523a941a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:09.784055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc4ef-c7bc-4530-8011-f523a941a463 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:09.784332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc4ef-c7bc-4530-8011-f523a941a463 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:09.784603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc4ef-c7bc-4530-8011-f523a941a463 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:09.785704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc4ef-c7bc-4530-8011-f523a941a463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:09.787151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc4ef-c7bc-4530-8011-f523a941a463 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:09.788685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 411/809] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:09.794839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda99f0f-5454-49b4-b7c4-ddb6a4337eb8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:10.004572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda99f0f-5454-49b4-b7c4-ddb6a4337eb8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:10.030905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:10.038635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109901a-4e00-4ecc-b263-7e17241752c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:10.039238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109901a-4e00-4ecc-b263-7e17241752c9 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:10.039518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109901a-4e00-4ecc-b263-7e17241752c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:10.039793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109901a-4e00-4ecc-b263-7e17241752c9 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:10.040449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109901a-4e00-4ecc-b263-7e17241752c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:10.041855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109901a-4e00-4ecc-b263-7e17241752c9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:10.065458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 399/810] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:54:09 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:10.948890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbdaf-4817-4921-9193-97876045ef61 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:10.949418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbdaf-4817-4921-9193-97876045ef61 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:10.949418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbdaf-4817-4921-9193-97876045ef61 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:10.950920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 412/811] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:10.956226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d2e5f-bbeb-46b0-bd47-095cfa8d80ea None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:10.956611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d2e5f-bbeb-46b0-bd47-095cfa8d80ea None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:10.956773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d2e5f-bbeb-46b0-bd47-095cfa8d80ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:10.976103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-557d2e5f-bbeb-46b0-bd47-095cfa8d80ea None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:10.977326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-557d2e5f-bbeb-46b0-bd47-095cfa8d80ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:11.042867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 400/812] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:11.312338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcbdaf-4817-4921-9193-97876045ef61 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:11.408969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:11.414275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcbdaf-4817-4921-9193-97876045ef61 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:11.448865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:11.449479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:11.449799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:11.450185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:11.460039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:11.464811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:11.466410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:11.467449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 413/813] 10.222.0.18 () {56 vars in 1120 bytes} [Sun Oct 23 19:54:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:11.472004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d2e5f-bbeb-46b0-bd47-095cfa8d80ea None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:11.568139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d2e5f-bbeb-46b0-bd47-095cfa8d80ea None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:11.581219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:11.601299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:11.601896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:11.602196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:11.602465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:11.603116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:11.603417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:11.604766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:11.613851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 401/814] 10.222.0.18 () {56 vars in 1115 bytes} [Sun Oct 23 19:54:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:11.619672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:11.720223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbc534-0958-4b0d-b670-5d222c543817 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:11.754108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:11.754731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:11.755010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:11.755286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:11.765958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:11.767427 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:54:11.781160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:11.782275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:54:11.783138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:54:11.783138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:11.783138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:11.783138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 414/815] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:54:11.787985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:11.884126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba56c6-5fb9-409f-9ba1-7b4ed5c7fd75 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:11.917103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:11.917700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:11.917981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:11.918426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:11.919066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:11.919375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:11.920726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:11.932120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 402/816] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:11.938734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:11.952247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:12.037805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8787b3-c027-4596-89bb-1325233e3439 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:12.071241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49d7fb-3d5e-4569-8be4-7c0c49457a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:12.071853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d7fb-3d5e-4569-8be4-7c0c49457a6b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.072127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d7fb-3d5e-4569-8be4-7c0c49457a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.072391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d7fb-3d5e-4569-8be4-7c0c49457a6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.079675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49d7fb-3d5e-4569-8be4-7c0c49457a6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:12.081089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49d7fb-3d5e-4569-8be4-7c0c49457a6b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5a49d7fb-3d5e-4569-8be4-7c0c49457a6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:54:12.092216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:12.093323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:12.094358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 415/817] 10.222.0.18 () {56 vars in 1093 bytes} [Sun Oct 23 19:54:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:12.099216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:12.134832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:12.201137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8e1c9-77be-4301-a5b7-fe1b3a42796d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:12.235207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:12.235804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.236080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.236350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.237068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:12.237369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:12.238940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:12.251495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9d62-d9eb-49a2-a780-c2d1db3be469 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.251783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9d62-d9eb-49a2-a780-c2d1db3be469 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.252063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9d62-d9eb-49a2-a780-c2d1db3be469 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.253397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 416/818] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:12.258471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdcdaf-b31a-4b09-afbf-3cd61ba3a545 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.258752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdcdaf-b31a-4b09-afbf-3cd61ba3a545 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.259022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdcdaf-b31a-4b09-afbf-3cd61ba3a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.260786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 403/819] 10.222.0.18 () {56 vars in 1133 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:12.267119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:12.279079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-10cdcdaf-b31a-4b09-afbf-3cd61ba3a545 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:12.280260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-10cdcdaf-b31a-4b09-afbf-3cd61ba3a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:12.344544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:12.349717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 417/820] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:54:12.360172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:12.367129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202aeb-a924-4d1f-ad81-e377944a16e0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:12.400246 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:12.400781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.401056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.401323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.467223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:12.468636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:12.555919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:12.563677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 404/821] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 19:54:12.569319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdcdaf-b31a-4b09-afbf-3cd61ba3a545 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:12.616231 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:12.679925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdcdaf-b31a-4b09-afbf-3cd61ba3a545 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:12.713939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:12.714579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.714857 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.715540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c250-0668-42ea-8cb4-52e2cdab5f0e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:12.716098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.725670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:12.727128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:54:12.742337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:12.743400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:54:12.744305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:54:12.744305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:54:12.744305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:12.744305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 418/822] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:12.749131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:12.750865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:12.751486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.751762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.752028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.761828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:12.767729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:12.768841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:12.769861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 405/823] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:12.774702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:12.804164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:12.832108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:12.851696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f04cdd-54c1-4425-b05e-d5ecd556b4e3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:12.876628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c785656-a85b-4df4-a247-3bbc97a0cd78 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:12.885484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:12.886101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.886392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.886662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.887374 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:12.887672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:12.889021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:12.900463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 419/824] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:12.906179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:12.909429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:12.910037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:12.910339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:12.910616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:12.911279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:12.911584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:12.912933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:12.921466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 406/825] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:12.927173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:13.005571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dc122-41e3-4387-b482-fee3dcd9b7f3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:13.018741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:13.026220 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135c27-4664-4cac-bb6e-27712d0b17a2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:13.041476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:13.042103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:13.042408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:13.042679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:13.042804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:13.049244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:13.050769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:13.061715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:54:13.061889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:13.063198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:54:13.064094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:13.064516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:13.064516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:13.064516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] PATH_INFO: `/v3/users/a79dcf766d03432780156904abcad6ef` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:13.064712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 420/826] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:54:13.068939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:13.077717 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] RBAC: Authorizing `identity:get_user(user_id=a79dcf766d03432780156904abcad6ef)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:13.079173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:13.080811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 407/827] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:12 2022] GET /identity/v3/users/a79dcf766d03432780156904abcad6ef => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:13.086466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:13.167094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42754a62-8933-4dc9-a85f-48de26b11164 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:13.183535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851e69-785e-4cd5-ae88-334214521adb None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:13.200553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:13.201143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:13.201417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:13.201686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:13.202394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:13.202698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:13.204217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:13.216470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 421/828] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:54:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:13.217834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:13.218494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:13.218773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:13.219044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] PATH_INFO: `/v3/projects/559b0cd4546849fb9e428400528af8b1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:13.220150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] RBAC: Authorizing `identity:get_project(project_id=559b0cd4546849fb9e428400528af8b1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:13.221631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:13.222490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:13.223283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 408/829] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:13 2022] GET /identity/v3/projects/559b0cd4546849fb9e428400528af8b1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:13.228958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:13.253224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:13.271632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:13.321961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4cab9-337b-4144-aab3-aacd17d2275d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:13.327632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa39f6-d328-42b6-a45a-2de286c60485 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:13.356604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573260-e622-4a36-a178-957d6beac3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:13.357199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573260-e622-4a36-a178-957d6beac3ee None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:13.357478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573260-e622-4a36-a178-957d6beac3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:13.357754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573260-e622-4a36-a178-957d6beac3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:13.358507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573260-e622-4a36-a178-957d6beac3ee None admin] RBAC: Adding query filter params (role.id=630e4775b76c4761ae25bea28d994b51, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=155cc268d5ef4e47bb7a16093a360ba7) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:13.358817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573260-e622-4a36-a178-957d6beac3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:13.360236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573260-e622-4a36-a178-957d6beac3ee None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:13.361549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d23c2-fda1-4fa6-be8a-1c222f1b2e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:13.362221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d23c2-fda1-4fa6-be8a-1c222f1b2e09 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:13.362499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d23c2-fda1-4fa6-be8a-1c222f1b2e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:13.362771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d23c2-fda1-4fa6-be8a-1c222f1b2e09 None admin] PATH_INFO: `/v3/projects/559b0cd4546849fb9e428400528af8b1/users/a79dcf766d03432780156904abcad6ef/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:13.364641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d23c2-fda1-4fa6-be8a-1c222f1b2e09 None admin] RBAC: Authorizing `identity:create_grant(project_id=559b0cd4546849fb9e428400528af8b1, user_id=a79dcf766d03432780156904abcad6ef, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:13.365958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 422/830] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:54:13 2022] GET /identity/v3/role_assignments?user.id=155cc268d5ef4e47bb7a16093a360ba7&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=630e4775b76c4761ae25bea28d994b51 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:54:13.366096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d23c2-fda1-4fa6-be8a-1c222f1b2e09 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:13.380793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 409/831] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:54:13 2022] PUT /identity/v3/projects/559b0cd4546849fb9e428400528af8b1/users/a79dcf766d03432780156904abcad6ef/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:54:15.525659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d20c4-c818-4793-bb42-1d3103eae515 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:15.526205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d20c4-c818-4793-bb42-1d3103eae515 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:15.526325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d20c4-c818-4793-bb42-1d3103eae515 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:15.528168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 423/832] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:15.533693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d775bb-f0c3-40c1-b6bf-47722a560e38 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:15.534113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d775bb-f0c3-40c1-b6bf-47722a560e38 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:15.534271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d775bb-f0c3-40c1-b6bf-47722a560e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:15.552426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c6d775bb-f0c3-40c1-b6bf-47722a560e38 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:15.553586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c6d775bb-f0c3-40c1-b6bf-47722a560e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:15.616995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 410/833] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:15.883139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d20c4-c818-4793-bb42-1d3103eae515 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:15.976612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:15.984086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d20c4-c818-4793-bb42-1d3103eae515 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:16.017593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:16.018241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:16.018525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:16.018800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:16.029450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:16.034221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:16.035294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:16.036473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 424/834] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:54:16.041332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d775bb-f0c3-40c1-b6bf-47722a560e38 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:16.071144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:16.138408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d775bb-f0c3-40c1-b6bf-47722a560e38 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:16.171480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:16.172073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:16.172353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:16.172626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:16.173282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:16.173587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:16.174963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:16.182695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 411/835] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:16.190626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:16.289063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a329a-89b8-4659-8dac-ddb07bcbb4e6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:16.322156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:16.322760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:16.323036 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:16.323305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] PATH_INFO: `/v3/users/a79dcf766d03432780156904abcad6ef` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:16.324501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=a79dcf766d03432780156904abcad6ef)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:16.326345 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:16.327884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 425/836] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:16 2022] GET /identity/v3/users/a79dcf766d03432780156904abcad6ef => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:16.333617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:16.423665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:16.430444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23061266-6343-4067-9052-5f94c29f4525 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:16.462272 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:16.462862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:16.463137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:16.463416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:16.529055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:16.530510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:16.619108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:16.627034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 412/837] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:54:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:54:16.632863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:16.659347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:16.733104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d05e0-9825-4480-88e2-71b90b64d1a9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:16.766304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c889d-68dc-47f6-8d51-65c78d4e3686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:16.766913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c889d-68dc-47f6-8d51-65c78d4e3686 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:16.767189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c889d-68dc-47f6-8d51-65c78d4e3686 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:16.767458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c889d-68dc-47f6-8d51-65c78d4e3686 None admin] PATH_INFO: `/v3/projects/559b0cd4546849fb9e428400528af8b1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:16.768548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c889d-68dc-47f6-8d51-65c78d4e3686 None admin] RBAC: Authorizing `identity:get_project(project_id=559b0cd4546849fb9e428400528af8b1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:16.769950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c889d-68dc-47f6-8d51-65c78d4e3686 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:16.771569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 426/838] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:16 2022] GET /identity/v3/projects/559b0cd4546849fb9e428400528af8b1 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:16.778707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:16.873266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9818b-cc28-4e09-90c1-d687b27a7e14 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:16.906224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c6d08-afce-4ba3-8cae-094c87cebaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:16.906802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6d08-afce-4ba3-8cae-094c87cebaca None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:16.907077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6d08-afce-4ba3-8cae-094c87cebaca None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:16.907346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6d08-afce-4ba3-8cae-094c87cebaca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:16.908051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6d08-afce-4ba3-8cae-094c87cebaca None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=559b0cd4546849fb9e428400528af8b1, user.id=a79dcf766d03432780156904abcad6ef) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:16.908354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6d08-afce-4ba3-8cae-094c87cebaca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:16.909742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6d08-afce-4ba3-8cae-094c87cebaca None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:16.915219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 413/839] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:54:16 2022] GET /identity/v3/role_assignments?user.id=a79dcf766d03432780156904abcad6ef&scope.project.id=559b0cd4546849fb9e428400528af8b1&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:19.047574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598a81-ed18-4f8b-a5e6-8b6083670500 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:19.048068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598a81-ed18-4f8b-a5e6-8b6083670500 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:19.048068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598a81-ed18-4f8b-a5e6-8b6083670500 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:19.049347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 427/840] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:19.054709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75888-4bd2-4267-8fe8-5c8142b80784 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:19.055076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75888-4bd2-4267-8fe8-5c8142b80784 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:19.055257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75888-4bd2-4267-8fe8-5c8142b80784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:19.073287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f7a75888-4bd2-4267-8fe8-5c8142b80784 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:19.075043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f7a75888-4bd2-4267-8fe8-5c8142b80784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:19.125404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:19.139341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 414/841] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:19.410484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27598a81-ed18-4f8b-a5e6-8b6083670500 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:19.498824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:19.508640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27598a81-ed18-4f8b-a5e6-8b6083670500 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:19.541465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3123ae-2928-4405-a955-c8eac1d85089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:19.542068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3123ae-2928-4405-a955-c8eac1d85089 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:19.542388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3123ae-2928-4405-a955-c8eac1d85089 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:19.542646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3123ae-2928-4405-a955-c8eac1d85089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:19.544308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3123ae-2928-4405-a955-c8eac1d85089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:19.545720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3123ae-2928-4405-a955-c8eac1d85089 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:19.547302 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 428/842] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:19.552885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75888-4bd2-4267-8fe8-5c8142b80784 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:19.648468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75888-4bd2-4267-8fe8-5c8142b80784 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:19.681204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299e89-ef67-4307-8af4-0e442f0712b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:19.681745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299e89-ef67-4307-8af4-0e442f0712b9 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:19.682027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299e89-ef67-4307-8af4-0e442f0712b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:19.682331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299e89-ef67-4307-8af4-0e442f0712b9 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:19.682988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32299e89-ef67-4307-8af4-0e442f0712b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:19.685075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32299e89-ef67-4307-8af4-0e442f0712b9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:19.705297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 415/843] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:54:19 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:21.873774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f7a3-91ca-4f1f-a353-5892f9841f20 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:21.874302 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f7a3-91ca-4f1f-a353-5892f9841f20 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:21.874302 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f7a3-91ca-4f1f-a353-5892f9841f20 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:21.875603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 429/844] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:21.880801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8d27-1bc6-4522-9a03-e22877d70366 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:21.881164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8d27-1bc6-4522-9a03-e22877d70366 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:21.881365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8d27-1bc6-4522-9a03-e22877d70366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:21.900007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ab3b8d27-1bc6-4522-9a03-e22877d70366 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:21.901189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ab3b8d27-1bc6-4522-9a03-e22877d70366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:21.939773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:21.968066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 416/845] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:22.232095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246f7a3-91ca-4f1f-a353-5892f9841f20 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:22.331492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246f7a3-91ca-4f1f-a353-5892f9841f20 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:22.363378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:22.363979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:22.364254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:22.364521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] PATH_INFO: `/v3/roles/658c99e6ef4841b5844a33d88f1b2d68` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:22.365871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] RBAC: Authorizing `identity:get_role(role_id=658c99e6ef4841b5844a33d88f1b2d68)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:22.367269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:22.368554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 430/846] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:22 2022] GET /identity/v3/roles/658c99e6ef4841b5844a33d88f1b2d68 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:22.374882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b8d27-1bc6-4522-9a03-e22877d70366 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:22.470849 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b8d27-1bc6-4522-9a03-e22877d70366 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:22.504235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:22.504813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:22.505091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:22.505361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] PATH_INFO: `/v3/users/cd3ab7b2a82f4cdea93b9265968adb43` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:22.518610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] RBAC: Authorizing `identity:get_user(user_id=cd3ab7b2a82f4cdea93b9265968adb43)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:22.520013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:22.521561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 417/847] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:22 2022] GET /identity/v3/users/cd3ab7b2a82f4cdea93b9265968adb43 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:22.527194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:22.554827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:22.624900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cb2a7-d9fe-48b2-a31b-bac6b435fc38 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:22.657541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85903c7f-6653-48c9-bcc6-e3e369c27ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:22.658182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903c7f-6653-48c9-bcc6-e3e369c27ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:22.658468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903c7f-6653-48c9-bcc6-e3e369c27ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:22.658743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85903c7f-6653-48c9-bcc6-e3e369c27ef9 None admin] PATH_INFO: `/v3/projects/559b0cd4546849fb9e428400528af8b1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:22.659848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85903c7f-6653-48c9-bcc6-e3e369c27ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=559b0cd4546849fb9e428400528af8b1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:22.661261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85903c7f-6653-48c9-bcc6-e3e369c27ef9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:22.662899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 431/848] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:22 2022] GET /identity/v3/projects/559b0cd4546849fb9e428400528af8b1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:22.669355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:22.701037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:22.767050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293932-f506-441f-bcc8-a89058fe3b7b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:22.799069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4174f-04d3-4f18-80d7-c95e2b414e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:22.799712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4174f-04d3-4f18-80d7-c95e2b414e62 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:22.799992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4174f-04d3-4f18-80d7-c95e2b414e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:22.800266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4174f-04d3-4f18-80d7-c95e2b414e62 None admin] PATH_INFO: `/v3/projects/559b0cd4546849fb9e428400528af8b1/users/cd3ab7b2a82f4cdea93b9265968adb43/roles/658c99e6ef4841b5844a33d88f1b2d68` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:22.802495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4174f-04d3-4f18-80d7-c95e2b414e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=559b0cd4546849fb9e428400528af8b1, user_id=cd3ab7b2a82f4cdea93b9265968adb43, role_id=658c99e6ef4841b5844a33d88f1b2d68)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:22.803900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4174f-04d3-4f18-80d7-c95e2b414e62 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:22.817144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 418/849] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:54:22 2022] PUT /identity/v3/projects/559b0cd4546849fb9e428400528af8b1/users/cd3ab7b2a82f4cdea93b9265968adb43/roles/658c99e6ef4841b5844a33d88f1b2d68 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:54:24.958430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced361-a5b9-4da9-980a-a1f4ec785504 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:24.963049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced361-a5b9-4da9-980a-a1f4ec785504 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:24.963049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced361-a5b9-4da9-980a-a1f4ec785504 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:24.963049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 432/850] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:24.966660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3c2e-67f3-4038-bca5-c682efcf0e25 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:24.967096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3c2e-67f3-4038-bca5-c682efcf0e25 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:24.967221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3c2e-67f3-4038-bca5-c682efcf0e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:24.985152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e84e3c2e-67f3-4038-bca5-c682efcf0e25 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:24.986357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e84e3c2e-67f3-4038-bca5-c682efcf0e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:25.050061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 419/851] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:25.316871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced361-a5b9-4da9-980a-a1f4ec785504 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:25.408527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:25.415038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced361-a5b9-4da9-980a-a1f4ec785504 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:25.448641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:25.449320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:25.449320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:25.449870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] PATH_INFO: `/v3/roles/658c99e6ef4841b5844a33d88f1b2d68` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:25.451246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] RBAC: Authorizing `identity:get_role(role_id=658c99e6ef4841b5844a33d88f1b2d68)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:25.452602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:25.453881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 433/852] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:25 2022] GET /identity/v3/roles/658c99e6ef4841b5844a33d88f1b2d68 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:25.459709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e3c2e-67f3-4038-bca5-c682efcf0e25 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:25.484529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:25.557976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e3c2e-67f3-4038-bca5-c682efcf0e25 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:25.590680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:25.591302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:25.591583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:25.591858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] PATH_INFO: `/v3/users/cd3ab7b2a82f4cdea93b9265968adb43` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:25.592975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] RBAC: Authorizing `identity:get_user(user_id=cd3ab7b2a82f4cdea93b9265968adb43)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:25.594411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:25.595974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 420/853] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:25 2022] GET /identity/v3/users/cd3ab7b2a82f4cdea93b9265968adb43 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:25.601800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:25.700023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa7b81-029a-4617-af92-f3ee18e73379 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:25.732536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:25.733123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:25.733400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:25.733669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:25.762754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:25.798001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:25.799472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:25.892645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 434/854] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:54:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:54:25.898508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:25.985303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:25.994718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be2cf-b107-456f-bf57-94f31b58f55b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:26.026882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55ef53-fc20-452e-93f8-1b3a313385c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:26.028397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55ef53-fc20-452e-93f8-1b3a313385c1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:26.028678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55ef53-fc20-452e-93f8-1b3a313385c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:26.028953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55ef53-fc20-452e-93f8-1b3a313385c1 None admin] PATH_INFO: `/v3/projects/559b0cd4546849fb9e428400528af8b1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:26.030053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55ef53-fc20-452e-93f8-1b3a313385c1 None admin] RBAC: Authorizing `identity:get_project(project_id=559b0cd4546849fb9e428400528af8b1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:26.031481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55ef53-fc20-452e-93f8-1b3a313385c1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:26.033094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 421/855] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:25 2022] GET /identity/v3/projects/559b0cd4546849fb9e428400528af8b1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:26.039431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:26.099170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:26.137359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab0aa-e61c-44b0-911e-5797c1725823 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:26.171289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aa74f-dc0c-442d-9a9a-a7c50062d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:26.171816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa74f-dc0c-442d-9a9a-a7c50062d0ec None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:26.172091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa74f-dc0c-442d-9a9a-a7c50062d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:26.172357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa74f-dc0c-442d-9a9a-a7c50062d0ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:26.173066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696aa74f-dc0c-442d-9a9a-a7c50062d0ec None admin] RBAC: Adding query filter params (role.id=658c99e6ef4841b5844a33d88f1b2d68, scope.project.id=559b0cd4546849fb9e428400528af8b1, user.id=cd3ab7b2a82f4cdea93b9265968adb43) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:26.173368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696aa74f-dc0c-442d-9a9a-a7c50062d0ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:26.174793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696aa74f-dc0c-442d-9a9a-a7c50062d0ec None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:26.180309 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 435/856] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:54:26 2022] GET /identity/v3/role_assignments?user.id=cd3ab7b2a82f4cdea93b9265968adb43&scope.project.id=559b0cd4546849fb9e428400528af8b1&role.id=658c99e6ef4841b5844a33d88f1b2d68 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:28.314074 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110f12-72ed-4ae0-8e82-8ddba57e898b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:28.314644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110f12-72ed-4ae0-8e82-8ddba57e898b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:28.314644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110f12-72ed-4ae0-8e82-8ddba57e898b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:28.315967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 422/857] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:28.321310 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2852a-4895-466b-b6d8-ef9ee22248dd None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:28.321736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2852a-4895-466b-b6d8-ef9ee22248dd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:28.321853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2852a-4895-466b-b6d8-ef9ee22248dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:28.340194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1cf2852a-4895-466b-b6d8-ef9ee22248dd None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:28.341364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1cf2852a-4895-466b-b6d8-ef9ee22248dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:28.407463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 436/858] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:28.676573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110f12-72ed-4ae0-8e82-8ddba57e898b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:28.773850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110f12-72ed-4ae0-8e82-8ddba57e898b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:28.806425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c2b31-5880-422f-8cf1-212ee0c1e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:28.807034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c2b31-5880-422f-8cf1-212ee0c1e681 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:28.807312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c2b31-5880-422f-8cf1-212ee0c1e681 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:28.807582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c2b31-5880-422f-8cf1-212ee0c1e681 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:28.808866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c2b31-5880-422f-8cf1-212ee0c1e681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:28.810302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c2b31-5880-422f-8cf1-212ee0c1e681 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:28.811838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 423/859] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:28.818047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2852a-4895-466b-b6d8-ef9ee22248dd None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:28.875363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:28.915418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2852a-4895-466b-b6d8-ef9ee22248dd None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:28.948265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d726bfd-f545-4542-8953-f92df09c1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:28.948858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726bfd-f545-4542-8953-f92df09c1027 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:28.949180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726bfd-f545-4542-8953-f92df09c1027 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:28.949500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d726bfd-f545-4542-8953-f92df09c1027 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:28.950166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d726bfd-f545-4542-8953-f92df09c1027 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:28.951582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d726bfd-f545-4542-8953-f92df09c1027 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:28.976677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 437/860] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:54:28 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:31.135299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ce0a-d9ed-420f-885d-1f77e5e3b801 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:31.135838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ce0a-d9ed-420f-885d-1f77e5e3b801 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:31.135838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ce0a-d9ed-420f-885d-1f77e5e3b801 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:31.137689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 424/861] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:31.142894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a34bbb-0768-4158-acb9-883acd8b8397 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:31.143327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a34bbb-0768-4158-acb9-883acd8b8397 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:31.143451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a34bbb-0768-4158-acb9-883acd8b8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:31.162617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-89a34bbb-0768-4158-acb9-883acd8b8397 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:31.163794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-89a34bbb-0768-4158-acb9-883acd8b8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:31.228650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 438/862] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:31.503070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ce0a-d9ed-420f-885d-1f77e5e3b801 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:31.529984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:31.600783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ce0a-d9ed-420f-885d-1f77e5e3b801 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:31.634856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3819e-dbdb-449a-ac59-e412b606ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:31.635472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3819e-dbdb-449a-ac59-e412b606ef50 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:31.635750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3819e-dbdb-449a-ac59-e412b606ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:31.636022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3819e-dbdb-449a-ac59-e412b606ef50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:31.637252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3819e-dbdb-449a-ac59-e412b606ef50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:31.638702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3819e-dbdb-449a-ac59-e412b606ef50 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:31.640266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 425/863] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:54:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:31.645982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a34bbb-0768-4158-acb9-883acd8b8397 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:31.687794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:31.745426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a34bbb-0768-4158-acb9-883acd8b8397 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:31.779026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e442-f3dc-4b3c-8341-03777383c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:31.779559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e442-f3dc-4b3c-8341-03777383c2bd None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:31.779838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e442-f3dc-4b3c-8341-03777383c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:31.780111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e442-f3dc-4b3c-8341-03777383c2bd None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:31.780746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e442-f3dc-4b3c-8341-03777383c2bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:31.782184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e442-f3dc-4b3c-8341-03777383c2bd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:31.803131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 439/864] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:54:31 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:33.975176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c651d5-bde8-40b4-91f7-b9e31c86cdc9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:33.975687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c651d5-bde8-40b4-91f7-b9e31c86cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:33.975687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c651d5-bde8-40b4-91f7-b9e31c86cdc9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:33.976992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 426/865] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:33.983025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b749a4-5c4d-44e6-b52d-540d8e80a7d8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:33.983456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b749a4-5c4d-44e6-b52d-540d8e80a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:33.983586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b749a4-5c4d-44e6-b52d-540d8e80a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:34.001985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b9b749a4-5c4d-44e6-b52d-540d8e80a7d8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:34.003186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b9b749a4-5c4d-44e6-b52d-540d8e80a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:34.066845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 440/866] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:34.334519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c651d5-bde8-40b4-91f7-b9e31c86cdc9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:34.426014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:34.434373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c651d5-bde8-40b4-91f7-b9e31c86cdc9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:34.466968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:34.467587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:34.467868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:34.468141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:34.477809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:34.483268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:34.484408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:34.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 427/867] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:54:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:34.490461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b749a4-5c4d-44e6-b52d-540d8e80a7d8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:34.517342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:34.589028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b749a4-5c4d-44e6-b52d-540d8e80a7d8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:34.623026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:34.623992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:34.624465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:34.624923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:34.626035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:34.626579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:34.628959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:34.640678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 441/868] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:54:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:34.647061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:34.742725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534c3ce-a1d4-424c-9289-9f7c20388efc None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:34.776145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:34.776752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:34.777029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:34.777873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] PATH_INFO: `/v3/users/d94b253e7aba4d3ea0c6bdf96f0fe8af` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:34.790236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] RBAC: Authorizing `identity:get_user(user_id=d94b253e7aba4d3ea0c6bdf96f0fe8af)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:34.791638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:34.793266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 428/869] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:34 2022] GET /identity/v3/users/d94b253e7aba4d3ea0c6bdf96f0fe8af => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:34.799008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:34.883943 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:34.896263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e1e01-2b3d-497e-b20e-890c0835166c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:34.930475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8c1e-205e-44e1-875e-d334edb2e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:34.931101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8c1e-205e-44e1-875e-d334edb2e336 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:34.931381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8c1e-205e-44e1-875e-d334edb2e336 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:34.931655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8c1e-205e-44e1-875e-d334edb2e336 None admin] PATH_INFO: `/v3/projects/e2e84e23fcee40f089e88e563ac7114e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:34.932771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf8c1e-205e-44e1-875e-d334edb2e336 None admin] RBAC: Authorizing `identity:get_project(project_id=e2e84e23fcee40f089e88e563ac7114e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:34.935052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf8c1e-205e-44e1-875e-d334edb2e336 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:34.936671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 442/870] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:34 2022] GET /identity/v3/projects/e2e84e23fcee40f089e88e563ac7114e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:34.943131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:34.958052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:35.040911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c7882-b989-48e4-a6f9-2ea15c8d4182 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:35.076156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddab3d-5004-40be-8948-48766db8901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:35.076806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddab3d-5004-40be-8948-48766db8901e None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:35.077089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddab3d-5004-40be-8948-48766db8901e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:35.077366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddab3d-5004-40be-8948-48766db8901e None admin] PATH_INFO: `/v3/projects/e2e84e23fcee40f089e88e563ac7114e/users/d94b253e7aba4d3ea0c6bdf96f0fe8af/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:35.079284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddab3d-5004-40be-8948-48766db8901e None admin] RBAC: Authorizing `identity:create_grant(project_id=e2e84e23fcee40f089e88e563ac7114e, user_id=d94b253e7aba4d3ea0c6bdf96f0fe8af, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:35.080703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddab3d-5004-40be-8948-48766db8901e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:35.095221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 429/871] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:54:34 2022] PUT /identity/v3/projects/e2e84e23fcee40f089e88e563ac7114e/users/d94b253e7aba4d3ea0c6bdf96f0fe8af/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:54:37.294199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972b6d-15d4-479e-946d-7de0fcebf59f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:37.294849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972b6d-15d4-479e-946d-7de0fcebf59f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:37.294849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972b6d-15d4-479e-946d-7de0fcebf59f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:37.296066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 443/872] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:37.301402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417103fb-baab-4ef4-85e3-3965852a196a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:37.301786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417103fb-baab-4ef4-85e3-3965852a196a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:37.301948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417103fb-baab-4ef4-85e3-3965852a196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:37.319956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-417103fb-baab-4ef4-85e3-3965852a196a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:37.321129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-417103fb-baab-4ef4-85e3-3965852a196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:37.384508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 430/873] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:37.653375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972b6d-15d4-479e-946d-7de0fcebf59f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:37.754694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972b6d-15d4-479e-946d-7de0fcebf59f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:37.787130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:37.787744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:37.788025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:37.788300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:37.799978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:37.804730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:37.805903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:37.807013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 444/874] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:54:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:37.813075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417103fb-baab-4ef4-85e3-3965852a196a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:37.815280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:37.908329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417103fb-baab-4ef4-85e3-3965852a196a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:37.940212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:37.940795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:37.941073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:37.941341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:37.941983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:37.942311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:37.943648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:37.951341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 431/875] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:54:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:37.957380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:37.975883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:38.054090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4085e9-67b0-4c82-9e38-ce74993083d0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:38.085615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:38.086246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:38.086527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:38.086797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] PATH_INFO: `/v3/users/d94b253e7aba4d3ea0c6bdf96f0fe8af` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:38.087890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=d94b253e7aba4d3ea0c6bdf96f0fe8af)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:38.089298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:38.091377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 445/876] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:37 2022] GET /identity/v3/users/d94b253e7aba4d3ea0c6bdf96f0fe8af => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:38.097150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:38.157029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:38.193200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a34e62-e4c9-4f56-9bf8-fd16347cd195 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:38.224911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:38.225498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:38.225777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:38.226048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:38.291306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:38.292750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:38.350899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:38.387430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 432/877] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:54:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:54:38.393243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:38.475895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:38.491432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb4d7f-3f06-49e8-ae31-02e11c2f7fa0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:38.523957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a3b84-507f-45d4-aeb6-0e4f2683360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:38.524558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a3b84-507f-45d4-aeb6-0e4f2683360c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:38.524833 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a3b84-507f-45d4-aeb6-0e4f2683360c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:38.525102 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a3b84-507f-45d4-aeb6-0e4f2683360c None admin] PATH_INFO: `/v3/projects/e2e84e23fcee40f089e88e563ac7114e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:38.526211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a3b84-507f-45d4-aeb6-0e4f2683360c None admin] RBAC: Authorizing `identity:get_project(project_id=e2e84e23fcee40f089e88e563ac7114e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:38.528232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a3b84-507f-45d4-aeb6-0e4f2683360c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:38.529812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 446/878] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:38 2022] GET /identity/v3/projects/e2e84e23fcee40f089e88e563ac7114e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:38.535811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:38.629688 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930e7f3-cd6e-4259-ba61-ee6c7ef49b62 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:38.662848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc5a5-f5ef-4437-b272-0dc04c1eb12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:38.663434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc5a5-f5ef-4437-b272-0dc04c1eb12d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:38.663711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc5a5-f5ef-4437-b272-0dc04c1eb12d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:38.663980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc5a5-f5ef-4437-b272-0dc04c1eb12d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:38.664689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc5a5-f5ef-4437-b272-0dc04c1eb12d None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=e2e84e23fcee40f089e88e563ac7114e, user.id=d94b253e7aba4d3ea0c6bdf96f0fe8af) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:38.664992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc5a5-f5ef-4437-b272-0dc04c1eb12d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:38.666417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc5a5-f5ef-4437-b272-0dc04c1eb12d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:38.671931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 433/879] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:54:38 2022] GET /identity/v3/role_assignments?user.id=d94b253e7aba4d3ea0c6bdf96f0fe8af&scope.project.id=e2e84e23fcee40f089e88e563ac7114e&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:40.815624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4517a2-cffd-4e2c-a3af-8eae1ee289b1 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:40.816169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4517a2-cffd-4e2c-a3af-8eae1ee289b1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:40.816169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4517a2-cffd-4e2c-a3af-8eae1ee289b1 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:40.817483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 447/880] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:40.822675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c764-9149-4a9a-a853-1ca8defb14dd None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:40.823089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c764-9149-4a9a-a853-1ca8defb14dd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:40.823234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c764-9149-4a9a-a853-1ca8defb14dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:40.841247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5a28c764-9149-4a9a-a853-1ca8defb14dd None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:40.842472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5a28c764-9149-4a9a-a853-1ca8defb14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:40.864678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:40.907389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 434/881] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:41.175740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4517a2-cffd-4e2c-a3af-8eae1ee289b1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:41.273992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4517a2-cffd-4e2c-a3af-8eae1ee289b1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:41.306707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d121a31-1e8c-4ee1-9b48-8721cc908cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:41.307290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121a31-1e8c-4ee1-9b48-8721cc908cfa None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:41.307567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121a31-1e8c-4ee1-9b48-8721cc908cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:41.307837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121a31-1e8c-4ee1-9b48-8721cc908cfa None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:41.308617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d121a31-1e8c-4ee1-9b48-8721cc908cfa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:41.309970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d121a31-1e8c-4ee1-9b48-8721cc908cfa None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:41.325736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 448/882] 10.222.0.18 () {60 vars in 1138 bytes} [Sun Oct 23 19:54:41 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:43.477820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2f18-5b7c-4fef-9427-aa1211fb9040 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:43.478407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2f18-5b7c-4fef-9427-aa1211fb9040 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:43.478407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2f18-5b7c-4fef-9427-aa1211fb9040 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:43.479731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 435/883] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:43.485380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e12d-1d3d-4fa0-a7bb-ec35559346e5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:43.485789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e12d-1d3d-4fa0-a7bb-ec35559346e5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:43.485924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e12d-1d3d-4fa0-a7bb-ec35559346e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:43.504171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e8c7e12d-1d3d-4fa0-a7bb-ec35559346e5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:43.505327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e8c7e12d-1d3d-4fa0-a7bb-ec35559346e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:43.513455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:43.572171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 449/884] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:43.836161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c2f18-5b7c-4fef-9427-aa1211fb9040 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:43.934168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c2f18-5b7c-4fef-9427-aa1211fb9040 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:43.966859 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9841e-2f63-4d55-ac99-18d7bf0be628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:43.967461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9841e-2f63-4d55-ac99-18d7bf0be628 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:43.967738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9841e-2f63-4d55-ac99-18d7bf0be628 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:43.968006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9841e-2f63-4d55-ac99-18d7bf0be628 None admin] PATH_INFO: `/v3/domains/28933f8176714c16939fb31438a6875a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:43.977867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9841e-2f63-4d55-ac99-18d7bf0be628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=28933f8176714c16939fb31438a6875a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:43.979305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9841e-2f63-4d55-ac99-18d7bf0be628 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:43.981390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 436/885] 10.222.0.18 () {56 vars in 1183 bytes} [Sun Oct 23 19:54:43 2022] GET /identity/v3/domains/28933f8176714c16939fb31438a6875a => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:43.987132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e12d-1d3d-4fa0-a7bb-ec35559346e5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:44.082361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e12d-1d3d-4fa0-a7bb-ec35559346e5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:44.115821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a9fc2-6271-4e99-9cd2-3b136304eec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:44.116359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a9fc2-6271-4e99-9cd2-3b136304eec4 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:44.116644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a9fc2-6271-4e99-9cd2-3b136304eec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:44.116922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a9fc2-6271-4e99-9cd2-3b136304eec4 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:44.117566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a9fc2-6271-4e99-9cd2-3b136304eec4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:44.119011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a9fc2-6271-4e99-9cd2-3b136304eec4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:44.132731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:44.145666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 450/886] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:54:43 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 19:54:46.359121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160dfdb-9ae0-41b5-9a2d-1196cd0d3251 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:46.359650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160dfdb-9ae0-41b5-9a2d-1196cd0d3251 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:46.359650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160dfdb-9ae0-41b5-9a2d-1196cd0d3251 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:46.360989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 437/887] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:46.366404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10649-5a2b-47c7-aefb-001a0b23e229 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:46.366808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10649-5a2b-47c7-aefb-001a0b23e229 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:46.367019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b10649-5a2b-47c7-aefb-001a0b23e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:46.385489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-90b10649-5a2b-47c7-aefb-001a0b23e229 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:46.387503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-90b10649-5a2b-47c7-aefb-001a0b23e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:46.452330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 451/888] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:46.725223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160dfdb-9ae0-41b5-9a2d-1196cd0d3251 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:46.744952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:46.826971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160dfdb-9ae0-41b5-9a2d-1196cd0d3251 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:46.859891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f752e9c-ce45-4087-9e90-066dc3cd0032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:46.860502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f752e9c-ce45-4087-9e90-066dc3cd0032 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:46.860783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f752e9c-ce45-4087-9e90-066dc3cd0032 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:46.861055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f752e9c-ce45-4087-9e90-066dc3cd0032 None admin] PATH_INFO: `/v3/domains/28933f8176714c16939fb31438a6875a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:46.862184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f752e9c-ce45-4087-9e90-066dc3cd0032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=28933f8176714c16939fb31438a6875a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:46.863602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f752e9c-ce45-4087-9e90-066dc3cd0032 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:46.865164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 438/889] 10.222.0.18 () {56 vars in 1183 bytes} [Sun Oct 23 19:54:46 2022] GET /identity/v3/domains/28933f8176714c16939fb31438a6875a => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:46.871559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10649-5a2b-47c7-aefb-001a0b23e229 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:46.967606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b10649-5a2b-47c7-aefb-001a0b23e229 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:46.990300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:47.001824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d672d-d7e2-4f1e-920e-6267c1c888f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:47.002456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d672d-d7e2-4f1e-920e-6267c1c888f3 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:47.002738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d672d-d7e2-4f1e-920e-6267c1c888f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:47.003012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d672d-d7e2-4f1e-920e-6267c1c888f3 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:47.003663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d672d-d7e2-4f1e-920e-6267c1c888f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:47.005071 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d672d-d7e2-4f1e-920e-6267c1c888f3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:47.026141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 452/890] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:54:46 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:54:49.182995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5466d-b1dc-4484-8033-128fd9e50e26 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:49.184174 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5466d-b1dc-4484-8033-128fd9e50e26 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:49.184616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5466d-b1dc-4484-8033-128fd9e50e26 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:49.185964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 439/891] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:49.191429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8721-564e-45dc-a40b-237f6611198d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:49.191801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8721-564e-45dc-a40b-237f6611198d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:49.191983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8721-564e-45dc-a40b-237f6611198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:49.210241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-117c8721-564e-45dc-a40b-237f6611198d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:49.211418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-117c8721-564e-45dc-a40b-237f6611198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:49.276394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 453/892] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:49.540489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5466d-b1dc-4484-8033-128fd9e50e26 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:49.626406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:49.642103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5466d-b1dc-4484-8033-128fd9e50e26 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:49.674438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:49.675055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:49.675336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:49.675615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:49.686318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:49.691325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:49.692377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:54:49.693376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 440/893] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:49.698428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8721-564e-45dc-a40b-237f6611198d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:49.791604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8721-564e-45dc-a40b-237f6611198d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:49.802136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:49.826822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:49.827410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:49.827686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:49.827953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:49.828600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:49.828897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:49.830266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:49.837907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 454/894] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:49.844400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:49.941321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11849059-9a71-4519-b212-2b5f3559d9d3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:49.973072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:49.973677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:49.973959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:49.974262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] PATH_INFO: `/v3/users/38a559328bc24c1e8223728606a11ebe` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:49.986758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] RBAC: Authorizing `identity:get_user(user_id=38a559328bc24c1e8223728606a11ebe)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:49.988172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:49.989730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 441/895] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:49 2022] GET /identity/v3/users/38a559328bc24c1e8223728606a11ebe => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:49.995260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:50.093400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919aeba-cbeb-4b80-840d-a45c95c68e35 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:50.125841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64f416-aa65-4155-9add-e5b1c240735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:50.126471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f416-aa65-4155-9add-e5b1c240735a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:50.126747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f416-aa65-4155-9add-e5b1c240735a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:50.127017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64f416-aa65-4155-9add-e5b1c240735a None admin] PATH_INFO: `/v3/projects/8178bc3f1aea40db9bc1a18a42eef5a2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:50.128095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f416-aa65-4155-9add-e5b1c240735a None admin] RBAC: Authorizing `identity:get_project(project_id=8178bc3f1aea40db9bc1a18a42eef5a2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:50.129498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64f416-aa65-4155-9add-e5b1c240735a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:50.131092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 455/896] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:49 2022] GET /identity/v3/projects/8178bc3f1aea40db9bc1a18a42eef5a2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:50.137594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:50.141299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:50.231460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419de0-c7f6-4d67-bc70-4df1018f52f3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:50.263531 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0222558-3b00-42dd-bad4-717480957907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:50.264163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222558-3b00-42dd-bad4-717480957907 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:50.264441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222558-3b00-42dd-bad4-717480957907 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:50.264711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222558-3b00-42dd-bad4-717480957907 None admin] PATH_INFO: `/v3/projects/8178bc3f1aea40db9bc1a18a42eef5a2/users/38a559328bc24c1e8223728606a11ebe/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:50.266593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222558-3b00-42dd-bad4-717480957907 None admin] RBAC: Authorizing `identity:create_grant(project_id=8178bc3f1aea40db9bc1a18a42eef5a2, user_id=38a559328bc24c1e8223728606a11ebe, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:50.267991 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222558-3b00-42dd-bad4-717480957907 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:50.280417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 442/897] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:54:50 2022] PUT /identity/v3/projects/8178bc3f1aea40db9bc1a18a42eef5a2/users/38a559328bc24c1e8223728606a11ebe/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:54:52.390676 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2099-5107-46ac-a28c-9b6814971910 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:52.391236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2099-5107-46ac-a28c-9b6814971910 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:52.391236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2099-5107-46ac-a28c-9b6814971910 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:52.392539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 456/898] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:54:52.397614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98618-2684-430f-ba61-4117ffb7d1f4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:52.398025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98618-2684-430f-ba61-4117ffb7d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:52.398200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98618-2684-430f-ba61-4117ffb7d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:52.416366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-28e98618-2684-430f-ba61-4117ffb7d1f4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:54:52.418127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-28e98618-2684-430f-ba61-4117ffb7d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:54:52.475032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:52.484876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 443/899] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:54:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:54:52.757788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f2099-5107-46ac-a28c-9b6814971910 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:52.799858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:52.857839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f2099-5107-46ac-a28c-9b6814971910 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:52.890508 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:52.891113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:52.891391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:52.891663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:52.902444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:54:52.907306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:54:52.908413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:54:52.909265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 457/900] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:54:52.914455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98618-2684-430f-ba61-4117ffb7d1f4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:53.008048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98618-2684-430f-ba61-4117ffb7d1f4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:53.040179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:53.040769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:53.041047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:53.041319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:53.041972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:53.042301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:53.043940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:53.051598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 444/901] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:53.057432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:53.152451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:53.155561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba8fc-b429-4024-8f2f-32826d616ad7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:53.189139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:53.189744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:53.190020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:53.190319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] PATH_INFO: `/v3/users/38a559328bc24c1e8223728606a11ebe` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:53.191423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] RBAC: Authorizing `identity:get_user(user_id=38a559328bc24c1e8223728606a11ebe)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:53.192838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:53.194420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 458/902] 10.222.0.18 () {56 vars in 1177 bytes} [Sun Oct 23 19:54:53 2022] GET /identity/v3/users/38a559328bc24c1e8223728606a11ebe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:53.200801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:53.262961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:53.306867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cc646-02ec-47bd-8048-ca5352ef08a3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:53.341350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:53.341985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:53.342335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:53.342611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:53.408823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:53.410492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:53.463916 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:54:53.507134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 445/903] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:54:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:54:53.514130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:53.609879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188f08-f6e1-4294-abdd-41ed5bfed84a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:53.642415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd41c32-d969-4585-b6ef-16b17d4623c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:53.643027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd41c32-d969-4585-b6ef-16b17d4623c4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:53.643304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd41c32-d969-4585-b6ef-16b17d4623c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:53.643573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd41c32-d969-4585-b6ef-16b17d4623c4 None admin] PATH_INFO: `/v3/projects/8178bc3f1aea40db9bc1a18a42eef5a2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:53.644656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd41c32-d969-4585-b6ef-16b17d4623c4 None admin] RBAC: Authorizing `identity:get_project(project_id=8178bc3f1aea40db9bc1a18a42eef5a2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:53.646073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd41c32-d969-4585-b6ef-16b17d4623c4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:53.647687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 459/904] 10.222.0.18 () {56 vars in 1186 bytes} [Sun Oct 23 19:54:53 2022] GET /identity/v3/projects/8178bc3f1aea40db9bc1a18a42eef5a2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:54:53.654397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:54:53.750133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6622-a72c-427d-baf8-982c976cb2f7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:54:53.782599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf5e6-ae57-4fd8-ac3c-0f85b74ada32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:54:53.783122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf5e6-ae57-4fd8-ac3c-0f85b74ada32 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:54:53.783399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf5e6-ae57-4fd8-ac3c-0f85b74ada32 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:54:53.783668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf5e6-ae57-4fd8-ac3c-0f85b74ada32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:54:53.784371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf5e6-ae57-4fd8-ac3c-0f85b74ada32 None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=8178bc3f1aea40db9bc1a18a42eef5a2, user.id=38a559328bc24c1e8223728606a11ebe) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:54:53.784672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf5e6-ae57-4fd8-ac3c-0f85b74ada32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:54:53.786068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf5e6-ae57-4fd8-ac3c-0f85b74ada32 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:54:53.791543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 446/905] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:54:53 2022] GET /identity/v3/role_assignments?user.id=38a559328bc24c1e8223728606a11ebe&scope.project.id=8178bc3f1aea40db9bc1a18a42eef5a2&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:03.638370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=82 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:03.789050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:49.840358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b11c3-0973-4972-9084-55d79b52aa53 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:49.841024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b11c3-0973-4972-9084-55d79b52aa53 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:49.841024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b11c3-0973-4972-9084-55d79b52aa53 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:49.842371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 460/906] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:55:49.848477 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fd4a-b963-4936-9f66-74175d72b10e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:49.849066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fd4a-b963-4936-9f66-74175d72b10e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:49.849066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fd4a-b963-4936-9f66-74175d72b10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:49.871271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c563fd4a-b963-4936-9f66-74175d72b10e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:55:49.872347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c563fd4a-b963-4936-9f66-74175d72b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:55:49.961947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 447/907] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:55:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:55:50.272931 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b11c3-0973-4972-9084-55d79b52aa53 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:50.431749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b11c3-0973-4972-9084-55d79b52aa53 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:50.484584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:50.485323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:50.485600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:50.485869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:50.501929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:50.503779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:55:50.523307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:50.524462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:55:50.532045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:55:50.532045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:50.532045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:55:50.532045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 461/908] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:55:50.532399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563fd4a-b963-4936-9f66-74175d72b10e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:50.681492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563fd4a-b963-4936-9f66-74175d72b10e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:50.716407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:50.725779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121b354-0341-4def-b47d-5e85ae31b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:50.726920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b354-0341-4def-b47d-5e85ae31b553 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:50.727228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b354-0341-4def-b47d-5e85ae31b553 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:50.727522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b354-0341-4def-b47d-5e85ae31b553 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:50.728179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121b354-0341-4def-b47d-5e85ae31b553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:50.728482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121b354-0341-4def-b47d-5e85ae31b553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:50.729955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121b354-0341-4def-b47d-5e85ae31b553 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:50.746142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 448/909] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:50.752120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:50.836463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:50.901785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fa95f-de77-4acb-92b3-d7835f997f74 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:50.948736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bac2b-7cd0-41a4-9817-f643c4abca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:50.949376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bac2b-7cd0-41a4-9817-f643c4abca9f None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:50.949813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bac2b-7cd0-41a4-9817-f643c4abca9f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:50.950176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bac2b-7cd0-41a4-9817-f643c4abca9f None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:50.950928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bac2b-7cd0-41a4-9817-f643c4abca9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:50.952359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bac2b-7cd0-41a4-9817-f643c4abca9f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:50.982171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 462/910] 10.222.0.18 () {60 vars in 1132 bytes} [Sun Oct 23 19:55:50 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:55:53.475888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e5d2-8c91-4e71-88d6-86e3d33ea62d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:53.476727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e5d2-8c91-4e71-88d6-86e3d33ea62d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:53.476727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e5d2-8c91-4e71-88d6-86e3d33ea62d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:53.477782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 449/911] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:55:53.483556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f4b4d-a4c4-4445-b44c-64662dc0452b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:53.484898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f4b4d-a4c4-4445-b44c-64662dc0452b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:53.484898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f4b4d-a4c4-4445-b44c-64662dc0452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:53.504484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-513f4b4d-a4c4-4445-b44c-64662dc0452b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:55:53.505656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-513f4b4d-a4c4-4445-b44c-64662dc0452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:55:53.586451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 463/912] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:55:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:55:53.873686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e5d2-8c91-4e71-88d6-86e3d33ea62d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:53.996267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e5d2-8c91-4e71-88d6-86e3d33ea62d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:54.033744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:54.034404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:54.034697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:54.034965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:54.050114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:55:54.051933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:54.053614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:55:54.054887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 450/913] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:55:54.059386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f4b4d-a4c4-4445-b44c-64662dc0452b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:54.110853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:54.190764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f4b4d-a4c4-4445-b44c-64662dc0452b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:54.231851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:54.233504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:54.233911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:54.234389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:54.235280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:54.235619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:54.237280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:54.248522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 464/914] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:55:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:54.254619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:54.314561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:54.378622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fadb1-123c-4c9d-9329-28875d93f7d7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:54.419051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:54.419781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:54.420205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:54.420408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:54.434538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:54.435983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:55:54.453033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:54.454059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:55:54.455029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:55:54.455029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:54.455029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:55:54.457558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 451/915] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:55:54.463304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:54.577990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:54.583256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35302589-ba5d-4a22-ae03-5fe3c9098eb5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:54.632589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:54.633677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:54.634045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:54.634354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:54.634984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:54.635305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:54.636905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:54.652692 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 465/916] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:54.659357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:54.771914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1919-573f-4199-82f4-052e7884726c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:54.774115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:54.813288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:54.814209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:54.814479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:54.814749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:54.822483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:54.824347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:55:54.836598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:54.838489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:55:54.839660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 452/917] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:55:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:55:54.843807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:54.991565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ef2dc-2964-4cbc-aff1-4ffc6dcc0a58 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:55.028803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:55.029318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:55.029598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:55.029878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:55.030631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:55.030939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:55.032355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:55.051480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 466/918] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Oct 23 19:55:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:55:55.058605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:55.177584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69985a36-2e9b-4878-b587-f39e3ee86026 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:55.225315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:55.226030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:55.226463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:55.226748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:55.238800 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:55.241397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:55:55.256890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:55.258317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:55:55.259225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:55:55.259225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:55.259225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:55:55.259225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 453/919] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:55:55.266697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:55.290275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:55.390897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d2d1-9419-4b44-b402-048f4e692c59 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:55.436524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:55.437143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:55.437435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:55.437715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:55.438360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:55.438930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:55.440297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:55.457551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 467/920] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:55.458504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:55.476095 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:55.587931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af2f6-afca-4d32-bd5f-7fc1f7fd1ea8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:55.635155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:55.636346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:55.637072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:55.637403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:55.646471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:55.647916 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:55:55.663888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:55.667801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:55:55.668906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 454/921] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:55:55.673863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:55.772576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:55.799527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc819ba-4637-4685-a631-2a2bdc77306c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:55.840576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86637f-6d1b-40dd-891e-6aeb1da27de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:55.841732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86637f-6d1b-40dd-891e-6aeb1da27de1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:55.842133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86637f-6d1b-40dd-891e-6aeb1da27de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:55.842400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86637f-6d1b-40dd-891e-6aeb1da27de1 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:55.843114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86637f-6d1b-40dd-891e-6aeb1da27de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:55.843412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86637f-6d1b-40dd-891e-6aeb1da27de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:55.845361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86637f-6d1b-40dd-891e-6aeb1da27de1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:55.864113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 468/922] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:55.870845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:55.961016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:55.992848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e0a5d-c545-453d-a97c-cba08ae64dc2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:56.042500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e8414-ade5-44e8-bc1a-9d5f4ada9f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:56.043379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8414-ade5-44e8-bc1a-9d5f4ada9f81 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:56.043687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8414-ade5-44e8-bc1a-9d5f4ada9f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:56.043976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8414-ade5-44e8-bc1a-9d5f4ada9f81 None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/f98a263de5ee43918dcb60bc1db5d04e/roles/73eca01d2c8f437dac85693be9186f9b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:56.063899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e8414-ade5-44e8-bc1a-9d5f4ada9f81 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=f98a263de5ee43918dcb60bc1db5d04e, role_id=73eca01d2c8f437dac85693be9186f9b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:56.065626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e8414-ade5-44e8-bc1a-9d5f4ada9f81 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:56.082540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 455/923] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:55:55 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/f98a263de5ee43918dcb60bc1db5d04e/roles/73eca01d2c8f437dac85693be9186f9b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 19:55:58.348231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e044b-e342-4864-857c-12aa680f2fc3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:58.348771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e044b-e342-4864-857c-12aa680f2fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:58.348877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e044b-e342-4864-857c-12aa680f2fc3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:58.350420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 469/924] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:55:58.357400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84438fbd-a5be-4762-9243-426a8da31d97 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:58.357858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84438fbd-a5be-4762-9243-426a8da31d97 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:58.358022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84438fbd-a5be-4762-9243-426a8da31d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:58.377001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-84438fbd-a5be-4762-9243-426a8da31d97 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:55:58.378335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-84438fbd-a5be-4762-9243-426a8da31d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:55:58.453248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 456/925] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:55:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:55:58.748464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e044b-e342-4864-857c-12aa680f2fc3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:58.876322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e044b-e342-4864-857c-12aa680f2fc3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:59.040030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:59.040798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:59.041152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:59.041594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:59.050711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:59.055807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:55:59.062272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:59.063333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:55:59.064505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 470/926] 10.222.0.18 () {56 vars in 1102 bytes} [Sun Oct 23 19:55:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:55:59.069769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84438fbd-a5be-4762-9243-426a8da31d97 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:59.127008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:59.178760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84438fbd-a5be-4762-9243-426a8da31d97 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:59.217373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:59.218025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:59.218380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:59.218654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:59.219309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:59.219629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:59.221186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:59.230324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 457/927] 10.222.0.18 () {56 vars in 1103 bytes} [Sun Oct 23 19:55:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:59.236340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:59.359139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd706d-0eda-4c3e-a2e5-7d8fcc5f5eb1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:59.401539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:59.402108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:59.402391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:59.402663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:59.413067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:59.414553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:55:59.430786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:59.431867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:55:59.432818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:55:59.432818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:55:59.432818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:55:59.432818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 471/928] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:55:59.439377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:59.560153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d97d3-b7f1-4ead-871b-c22ea42ef3a6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:59.577500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:59.605876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:59.609157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:59.609157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:59.609157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:59.609157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:59.609157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:59.609907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:59.624174 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 458/929] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:55:59.629781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:59.691191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:55:59.747202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffdb5-c4cb-47a4-8ff2-486d928296f8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:59.785331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:59.786175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:59.786583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:59.786967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:59.795410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:59.797129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:55:59.810499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:55:59.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:55:59.812694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 472/930] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:55:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:55:59.818258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:55:59.938812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452041a5-2c9c-4e52-9f77-074e0fa1d6e6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:55:59.978652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:55:59.979310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:55:59.979663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:55:59.979953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:55:59.980794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:55:59.981215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:55:59.983009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:00.003259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 459/931] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Oct 23 19:55:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:00.009760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:00.123205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9690c-caee-4546-9d12-1ccc883bd13b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:00.136846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:00.163142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:00.163900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:00.164251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:00.164557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:00.239456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:00.240936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:00.353629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 473/932] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:56:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:56:00.361551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:00.400115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:00.477150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162910-dd12-401e-b2e7-53a7a2a9f14d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:00.517344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:00.518029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:00.518325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:00.518640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:00.530366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:00.531829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:56:00.548965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:00.550022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:56:00.551411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:56:00.551411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:00.551411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:00.551411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 460/933] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:00.556218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:00.568867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:00.666962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b437444-2c50-4414-a019-04cd328619d7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:00.704378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:00.704977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:00.705269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:00.705600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:00.706287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:00.706603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:00.708093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:00.720492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 474/934] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:00.726420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:00.817120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:00.835109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0ba03-3f5c-4f78-a176-2a5bd032446c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:00.876460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:00.877418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:00.877747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:00.878098 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:00.885053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:00.887297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:56:00.899472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:00.900676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:00.901718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 461/935] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:00.908184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:00.988234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:01.024468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df617443-99d7-4154-ae32-021611b0ea52 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:01.062876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f01673-1bc5-4a89-a422-781cdae4c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:01.063795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01673-1bc5-4a89-a422-781cdae4c966 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:01.064130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01673-1bc5-4a89-a422-781cdae4c966 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:01.064467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01673-1bc5-4a89-a422-781cdae4c966 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:01.065283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f01673-1bc5-4a89-a422-781cdae4c966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:01.065662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f01673-1bc5-4a89-a422-781cdae4c966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:01.067310 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f01673-1bc5-4a89-a422-781cdae4c966 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:01.080983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 475/936] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:56:01.087131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:01.193534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606a915-64ba-4b29-9f00-134352d1a30a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:01.235233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279a4d2-487d-4147-a885-a14dad731e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:01.235837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a4d2-487d-4147-a885-a14dad731e0b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:01.236121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a4d2-487d-4147-a885-a14dad731e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:01.236395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279a4d2-487d-4147-a885-a14dad731e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:01.237118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279a4d2-487d-4147-a885-a14dad731e0b None admin] RBAC: Adding query filter params (role.id=73eca01d2c8f437dac85693be9186f9b, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=f98a263de5ee43918dcb60bc1db5d04e) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:01.237429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279a4d2-487d-4147-a885-a14dad731e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:01.238873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279a4d2-487d-4147-a885-a14dad731e0b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:01.246365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 462/937] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:56:01 2022] GET /identity/v3/role_assignments?user.id=f98a263de5ee43918dcb60bc1db5d04e&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=73eca01d2c8f437dac85693be9186f9b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:03.543361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144e11-b49c-4c0a-a7ee-e4c44d9ba1aa None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:03.544343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144e11-b49c-4c0a-a7ee-e4c44d9ba1aa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:03.544343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144e11-b49c-4c0a-a7ee-e4c44d9ba1aa None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:03.546531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 476/938] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 19:56:03.551892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b8aa3-567b-429c-91cf-5fe443def9d5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:03.552514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b8aa3-567b-429c-91cf-5fe443def9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:03.552514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b8aa3-567b-429c-91cf-5fe443def9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:03.571736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-211b8aa3-567b-429c-91cf-5fe443def9d5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:56:03.573585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-211b8aa3-567b-429c-91cf-5fe443def9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:56:03.576778 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:03.657245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 463/939] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:56:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:56:03.944755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a144e11-b49c-4c0a-a7ee-e4c44d9ba1aa None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:04.059109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a144e11-b49c-4c0a-a7ee-e4c44d9ba1aa None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:04.090570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:04.097595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:04.098260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:04.098544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:04.098803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:04.110759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:56:04.115459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:04.116512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:56:04.117662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 477/940] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:04.122669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b8aa3-567b-429c-91cf-5fe443def9d5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:04.234371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b8aa3-567b-429c-91cf-5fe443def9d5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:04.270987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:04.271539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:04.271826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:04.272087 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:04.272832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:04.273060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:04.274485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:04.283922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 464/941] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:04.290139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:04.406236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4376-62cb-44c2-aa11-a4d3337b1f30 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:04.445267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:04.445883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:04.446182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:04.446452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:04.456920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:04.458386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:56:04.474553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:04.475901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:56:04.476819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:56:04.476819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:04.476819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:56:04.476819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 478/942] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:56:04.482880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:04.486351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:04.593716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036741ab-5ff3-441e-bf49-43e841be5a11 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:04.633868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:04.634532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:04.634825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:04.635100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:04.636519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:04.636837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:04.638253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:04.652239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 465/943] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:04.657991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:04.705861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:04.773401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1857a-be79-4bc4-9300-5b456387f9b2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:04.812659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:04.813286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:04.813858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:04.814168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:04.822199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:04.824262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:56:04.836586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:04.837760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:56:04.839524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 479/944] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:56:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:04.845781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:04.922970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:04.971080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3899d-dcc9-4d47-aaab-55458ad5dbc4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:05.011090 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:05.011995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:05.012274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:05.012546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:05.013268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:05.013712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:05.015471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:05.035500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 466/945] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Oct 23 19:56:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:05.041291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:05.156160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d75357-7a2f-4b88-a9d8-7af03b2de8ab None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:05.157702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:05.193046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:05.193668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:05.193950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:05.194259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:05.206227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:05.207836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:56:05.223864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:05.225246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:56:05.226560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:56:05.226560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:05.226560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:56:05.226560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 480/946] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:05.231363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:05.359062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd08464-0c53-4931-a61b-a70eaa3a543b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:05.381602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:05.397837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:05.398520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:05.398799 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:05.399149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:05.399815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:05.400157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:05.402338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:05.414696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 467/947] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:05.421295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:05.533770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08e23-e56e-4c14-a4d2-63d8ebd41fa9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:05.570641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:05.571279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:05.571536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:05.571802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:05.579682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:05.581422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:56:05.593962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:05.595078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:56:05.596002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:56:05.600209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 481/948] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:56:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 19:56:05.602803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:05.717810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb4499-698a-4c85-aff5-f9f5b674127c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:05.754894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611548c2-437e-4625-9546-22e7473c8732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:05.755587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611548c2-437e-4625-9546-22e7473c8732 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:05.755815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611548c2-437e-4625-9546-22e7473c8732 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:05.756081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611548c2-437e-4625-9546-22e7473c8732 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:05.756764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611548c2-437e-4625-9546-22e7473c8732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:05.757065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611548c2-437e-4625-9546-22e7473c8732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:05.758687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611548c2-437e-4625-9546-22e7473c8732 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:05.772439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 468/949] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:56:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:05.778465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:05.795930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:05.894486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf892-f3c8-42df-9200-8dc3124eb9fa None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:05.931215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e6c17-717f-4178-99e7-b5498421a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:05.931936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e6c17-717f-4178-99e7-b5498421a0fc None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:05.932705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e6c17-717f-4178-99e7-b5498421a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:05.933033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e6c17-717f-4178-99e7-b5498421a0fc None admin] PATH_INFO: `/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/f98a263de5ee43918dcb60bc1db5d04e/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:05.935098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e6c17-717f-4178-99e7-b5498421a0fc None admin] RBAC: Authorizing `identity:create_grant(project_id=f5039f9cd4374d51bdd4c3e52e1edcfe, user_id=f98a263de5ee43918dcb60bc1db5d04e, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:05.936570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e6c17-717f-4178-99e7-b5498421a0fc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:05.949788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 482/950] 10.222.0.18 () {58 vars in 1439 bytes} [Sun Oct 23 19:56:05 2022] PUT /identity/v3/projects/f5039f9cd4374d51bdd4c3e52e1edcfe/users/f98a263de5ee43918dcb60bc1db5d04e/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 19:56:08.301511 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82516c9-ab98-4863-b092-a6c1a0c92dce None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:08.302057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82516c9-ab98-4863-b092-a6c1a0c92dce None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:08.302057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82516c9-ab98-4863-b092-a6c1a0c92dce None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:08.303511 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 469/951] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:56:08.310468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ac94-e52a-442b-989b-751b7c51b876 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:08.310918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ac94-e52a-442b-989b-751b7c51b876 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:08.311200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ac94-e52a-442b-989b-751b7c51b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:08.334321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b8e8ac94-e52a-442b-989b-751b7c51b876 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:56:08.335893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b8e8ac94-e52a-442b-989b-751b7c51b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:56:08.409363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 483/952] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:56:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:56:08.676183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82516c9-ab98-4863-b092-a6c1a0c92dce None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:08.722607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:08.789748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82516c9-ab98-4863-b092-a6c1a0c92dce None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:08.828120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:08.828749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:08.829033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:08.829310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:08.840417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 19:56:08.845196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:08.846207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:08.847067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 470/953] 10.222.0.18 () {56 vars in 1096 bytes} [Sun Oct 23 19:56:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:08.852551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8ac94-e52a-442b-989b-751b7c51b876 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:08.856893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:08.965593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8ac94-e52a-442b-989b-751b7c51b876 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:09.003546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:09.004175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:09.004458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:09.004733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:09.005409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:09.005716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:09.007137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:09.016874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 484/954] 10.222.0.18 () {56 vars in 1099 bytes} [Sun Oct 23 19:56:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:09.022923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:09.127374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:09.130571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81eeb9-2ede-4ee2-9425-b81a533a0fea None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:09.167812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:09.168441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:09.168724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:09.169005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:09.179562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:09.181023 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:56:09.197267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:09.198636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:56:09.199515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:56:09.199515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:09.199515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:09.199515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 471/955] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:09.204480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:09.277906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:09.320937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b955c-1053-4309-98c1-0cb6f9a2d56d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:09.358128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:09.358755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:09.359038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:09.359311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:09.359960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:09.360273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:09.361648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:09.375370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 485/956] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:09.381135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:09.481844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a090163-d28a-4e51-8ad8-cbd75cbe2400 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:09.515578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:09.516220 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:09.516500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:09.516775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:09.524325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:09.526291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 19:56:09.537536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:09.538576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:09.540014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 472/957] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:56:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:09.545166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:09.648695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57c795-e877-415c-8e3d-4de7c0e1bb1d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:09.674443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:09.683508 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:09.684101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:09.684386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:09.684660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:09.685380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:09.685683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:09.687128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:09.703984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 486/958] 10.222.0.18 () {56 vars in 1143 bytes} [Sun Oct 23 19:56:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:09.709744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:09.725323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:09.807613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383365a-5ec3-4bca-b943-e1ed7e9efe4e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:09.840423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:09.841017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:09.841295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:09.841566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:09.906589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:09.907948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:09.921012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:10.002983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 473/959] 10.222.0.18 () {58 vars in 1282 bytes} [Sun Oct 23 19:56:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 19:56:10.008735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:10.106096 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc40be-d768-4139-9050-c18c83f83d4a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:10.139054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:10.139652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:10.139926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:10.140193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:10.149585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:10.151578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 19:56:10.165758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:10.166972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 19:56:10.168146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 19:56:10.168146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 19:56:10.168146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:56:10.168146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 487/960] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 19:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:10.172560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:10.273453 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323591-2e37-47b8-8253-4ba93b8e4b0a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:10.291358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:10.317739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:10.318367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:10.318651 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:10.318926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:10.319559 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:10.319863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:10.321212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:10.332691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 474/961] 10.222.0.18 () {56 vars in 1109 bytes} [Sun Oct 23 19:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:10.338553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:10.373326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:10.435959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8df1a5-4480-467d-98ee-0bf3350c512e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:10.468597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:10.469209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:10.469487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:10.469757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:10.476248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:10.477668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 19:56:10.488625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:10.489659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 23 19:56:10.490600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 488/962] 10.222.0.18 () {56 vars in 1111 bytes} [Sun Oct 23 19:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:10.496168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:10.592329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc0550-8318-41ee-b557-72177cb02fc2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:10.625820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca99031-7321-4ab5-93bd-8a9c56cec7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:10.626457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99031-7321-4ab5-93bd-8a9c56cec7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:10.626738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99031-7321-4ab5-93bd-8a9c56cec7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:10.627010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99031-7321-4ab5-93bd-8a9c56cec7f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:10.627691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca99031-7321-4ab5-93bd-8a9c56cec7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:10.627995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca99031-7321-4ab5-93bd-8a9c56cec7f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:10.629402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca99031-7321-4ab5-93bd-8a9c56cec7f9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:10.640976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 475/963] 10.222.0.18 () {56 vars in 1148 bytes} [Sun Oct 23 19:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:56:10.647074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:10.738361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:10.744151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c56c0-cb26-4808-9e3d-d3e24e0c37b4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:10.777593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bd102-61a1-4045-af03-c1e2d15564f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:10.778193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd102-61a1-4045-af03-c1e2d15564f0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:10.778473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd102-61a1-4045-af03-c1e2d15564f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:10.778744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bd102-61a1-4045-af03-c1e2d15564f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:10.779454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bd102-61a1-4045-af03-c1e2d15564f0 None admin] RBAC: Adding query filter params (role.id=33f053640f414ee688b1cbf6d6707471, scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe, user.id=f98a263de5ee43918dcb60bc1db5d04e) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:10.779759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bd102-61a1-4045-af03-c1e2d15564f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:10.781166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bd102-61a1-4045-af03-c1e2d15564f0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:10.786704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 489/964] 10.222.0.18 () {56 vars in 1374 bytes} [Sun Oct 23 19:56:10 2022] GET /identity/v3/role_assignments?user.id=f98a263de5ee43918dcb60bc1db5d04e&scope.project.id=f5039f9cd4374d51bdd4c3e52e1edcfe&role.id=33f053640f414ee688b1cbf6d6707471 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 19:56:12.969949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1ad8-cab3-43d2-ab68-bfe648602606 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:12.970474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1ad8-cab3-43d2-ab68-bfe648602606 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:12.970474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f1ad8-cab3-43d2-ab68-bfe648602606 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:12.971784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 476/965] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:56:12.977032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcabb95-4f5a-46a8-a01f-0e288ae2efb0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:12.977422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcabb95-4f5a-46a8-a01f-0e288ae2efb0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:12.977582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcabb95-4f5a-46a8-a01f-0e288ae2efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:12.996699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6fcabb95-4f5a-46a8-a01f-0e288ae2efb0 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:56:12.997860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6fcabb95-4f5a-46a8-a01f-0e288ae2efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:56:13.061587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 490/966] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:56:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:56:13.333373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f1ad8-cab3-43d2-ab68-bfe648602606 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:13.363699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:13.432754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f1ad8-cab3-43d2-ab68-bfe648602606 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:13.465063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:13.465672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:13.465947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:13.466244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:13.466816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:13.468149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:13.476564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:13.477841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:13.478779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 477/967] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:56:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:13.483795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcabb95-4f5a-46a8-a01f-0e288ae2efb0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:13.572511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:13.582114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcabb95-4f5a-46a8-a01f-0e288ae2efb0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:13.615263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f6cb-f6ba-4615-9012-c57165c69124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:13.615865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f6cb-f6ba-4615-9012-c57165c69124 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:13.616140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f6cb-f6ba-4615-9012-c57165c69124 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:13.616410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f6cb-f6ba-4615-9012-c57165c69124 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:13.617029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f6cb-f6ba-4615-9012-c57165c69124 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:13.617327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f6cb-f6ba-4615-9012-c57165c69124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:13.618703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f6cb-f6ba-4615-9012-c57165c69124 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:13.624119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 491/968] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Oct 23 19:56:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:13.629750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:13.719704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:13.725718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451888e-11f6-41b0-9441-02af1cbfbf46 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:13.758186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c4ff-c316-4538-95e6-ae8c93983f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:13.758781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c4ff-c316-4538-95e6-ae8c93983f77 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:13.759064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c4ff-c316-4538-95e6-ae8c93983f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:13.759339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c4ff-c316-4538-95e6-ae8c93983f77 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:13.759963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c4ff-c316-4538-95e6-ae8c93983f77 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:13.760818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c4ff-c316-4538-95e6-ae8c93983f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:13.762417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c4ff-c316-4538-95e6-ae8c93983f77 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:13.766640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 478/969] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Oct 23 19:56:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:15.929854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576c3b-15aa-491e-a106-66a1638cd786 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:15.930397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576c3b-15aa-491e-a106-66a1638cd786 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:15.930397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576c3b-15aa-491e-a106-66a1638cd786 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:15.931686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 492/970] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:56:15.937482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bb70-90c8-44b1-8523-8f419c3d3dd4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:15.937898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bb70-90c8-44b1-8523-8f419c3d3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:15.938035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9bb70-90c8-44b1-8523-8f419c3d3dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:15.955987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-19f9bb70-90c8-44b1-8523-8f419c3d3dd4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:56:15.957169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-19f9bb70-90c8-44b1-8523-8f419c3d3dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:56:16.021279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 479/971] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:56:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 19:56:16.288920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08576c3b-15aa-491e-a106-66a1638cd786 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:16.389651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08576c3b-15aa-491e-a106-66a1638cd786 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:16.422397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33fa00-df86-4ea9-b865-08ac1a5b9d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:16.422984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33fa00-df86-4ea9-b865-08ac1a5b9d90 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:16.423262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33fa00-df86-4ea9-b865-08ac1a5b9d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:16.423533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33fa00-df86-4ea9-b865-08ac1a5b9d90 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:16.424173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33fa00-df86-4ea9-b865-08ac1a5b9d90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:16.425512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33fa00-df86-4ea9-b865-08ac1a5b9d90 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:16.440348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 493/972] 10.222.0.18 () {60 vars in 1141 bytes} [Sun Oct 23 19:56:16 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:56:18.719612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae35e0e-f886-4d2d-a63e-67c5f639c300 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:18.720167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae35e0e-f886-4d2d-a63e-67c5f639c300 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:18.720167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae35e0e-f886-4d2d-a63e-67c5f639c300 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:18.721504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 480/973] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:56:18.726940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5852bd-b4da-4039-8c20-db3e6053b457 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:18.727330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5852bd-b4da-4039-8c20-db3e6053b457 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:18.727546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5852bd-b4da-4039-8c20-db3e6053b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:18.746581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7b5852bd-b4da-4039-8c20-db3e6053b457 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:56:18.747746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7b5852bd-b4da-4039-8c20-db3e6053b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:56:18.756657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:18.820353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 494/974] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:56:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:56:19.089235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae35e0e-f886-4d2d-a63e-67c5f639c300 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:19.177950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:19.188507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae35e0e-f886-4d2d-a63e-67c5f639c300 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:19.221587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:19.222221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:19.222497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:19.222764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:19.223333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:19.224670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:19.234701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:19.235922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:19.237040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 481/975] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:56:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:19.241676 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5852bd-b4da-4039-8c20-db3e6053b457 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:19.352498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5852bd-b4da-4039-8c20-db3e6053b457 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:19.385756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:19.386380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:19.386661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:19.386933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:19.387550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:19.387854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:19.389213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:19.394164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 495/976] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Oct 23 19:56:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:19.400543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:19.496992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1173b-9722-4c9a-ae03-bc3571bdc57e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:19.529085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba46ef-42ba-4278-b4ca-19c326e05e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:19.529665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba46ef-42ba-4278-b4ca-19c326e05e6b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:19.529943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba46ef-42ba-4278-b4ca-19c326e05e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:19.530243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba46ef-42ba-4278-b4ca-19c326e05e6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:19.530925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba46ef-42ba-4278-b4ca-19c326e05e6b None admin] RBAC: Adding query filter params (interface=public, service_id=db9c67d6c03b455fb21eefc826a3efa3, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:19.531230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba46ef-42ba-4278-b4ca-19c326e05e6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:19.532567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba46ef-42ba-4278-b4ca-19c326e05e6b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:19.537352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 482/977] 10.222.0.18 () {56 vars in 1251 bytes} [Sun Oct 23 19:56:19 2022] GET /identity/v3/endpoints?service_id=db9c67d6c03b455fb21eefc826a3efa3&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:19.543437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:19.547136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:19.641989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e01ef6-7fe0-4a58-9fd0-cabd097b72f4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:19.675103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a236cad-765d-4b9a-9283-a1acae194922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:19.675689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a236cad-765d-4b9a-9283-a1acae194922 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:19.675964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a236cad-765d-4b9a-9283-a1acae194922 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:19.676233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a236cad-765d-4b9a-9283-a1acae194922 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:19.676824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a236cad-765d-4b9a-9283-a1acae194922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:19.678188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a236cad-765d-4b9a-9283-a1acae194922 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:19.685279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 496/978] 10.222.0.18 () {56 vars in 1087 bytes} [Sun Oct 23 19:56:19 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 19:56:21.843598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f06c2-ff89-456c-aee7-53a1a65e4deb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:21.844121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f06c2-ff89-456c-aee7-53a1a65e4deb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:21.844121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f06c2-ff89-456c-aee7-53a1a65e4deb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:21.845484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 483/979] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:56:21.850749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2adb7-45e6-4bb0-9b6f-7febc08db4fa None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:21.851153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2adb7-45e6-4bb0-9b6f-7febc08db4fa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:21.851298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2adb7-45e6-4bb0-9b6f-7febc08db4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:21.870551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4fd2adb7-45e6-4bb0-9b6f-7febc08db4fa None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:56:21.871668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4fd2adb7-45e6-4bb0-9b6f-7febc08db4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:56:21.930692 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:21.937091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 497/980] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:56:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 19:56:22.202868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f06c2-ff89-456c-aee7-53a1a65e4deb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:22.222514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:22.315394 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f06c2-ff89-456c-aee7-53a1a65e4deb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:22.352048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:22.352666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:22.352944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:22.353216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:22.354463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:22.355817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 19:56:22.364319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 19:56:22.365486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 23 19:56:22.366406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 484/981] 10.222.0.18 () {56 vars in 1117 bytes} [Sun Oct 23 19:56:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 19:56:22.371712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2adb7-45e6-4bb0-9b6f-7febc08db4fa None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:22.467799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2adb7-45e6-4bb0-9b6f-7febc08db4fa None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:22.500750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c46cf-0433-490c-a1a1-defd0774db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:22.501348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c46cf-0433-490c-a1a1-defd0774db85 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:22.501629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c46cf-0433-490c-a1a1-defd0774db85 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:22.501905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c46cf-0433-490c-a1a1-defd0774db85 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:22.502559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c46cf-0433-490c-a1a1-defd0774db85 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 19:56:22.502864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c46cf-0433-490c-a1a1-defd0774db85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:22.504223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c46cf-0433-490c-a1a1-defd0774db85 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:22.509222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 498/982] 10.222.0.18 () {56 vars in 1116 bytes} [Sun Oct 23 19:56:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 19:56:22.515305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:56:22.595718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:22.616095 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48700356-263d-4722-a21e-0361092e2bf5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:56:22.649867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5eecc-68a9-4e22-b912-9f2ab0a206ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:56:22.650490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5eecc-68a9-4e22-b912-9f2ab0a206ef None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:56:22.651761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5eecc-68a9-4e22-b912-9f2ab0a206ef None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:56:22.652040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5eecc-68a9-4e22-b912-9f2ab0a206ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:56:22.652709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5eecc-68a9-4e22-b912-9f2ab0a206ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:56:22.654049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5eecc-68a9-4e22-b912-9f2ab0a206ef None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:56:22.672868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 485/983] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 19:56:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 19:56:32.506410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=69 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:56:32.668784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:27.033195 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2acac-56e0-4c0b-bcc9-fc207ab6cbdd None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:27.033671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2acac-56e0-4c0b-bcc9-fc207ab6cbdd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:27.033750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2acac-56e0-4c0b-bcc9-fc207ab6cbdd None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:27.041379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873229d7-adaf-44cc-bc71-6401b77f48b7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:27.041845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873229d7-adaf-44cc-bc71-6401b77f48b7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:27.042122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873229d7-adaf-44cc-bc71-6401b77f48b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:27.047289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 499/984] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:27.128621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-873229d7-adaf-44cc-bc71-6401b77f48b7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:27.129733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-873229d7-adaf-44cc-bc71-6401b77f48b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:27.255607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 486/985] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:27.550814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090f4a-2800-4d46-a876-ad87f716254a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:27.551138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090f4a-2800-4d46-a876-ad87f716254a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:27.551376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090f4a-2800-4d46-a876-ad87f716254a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:27.552896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 500/986] 10.222.0.18 () {54 vars in 964 bytes} [Sun Oct 23 19:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:27.559790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5a55-7acd-41b2-9337-92ab8893ff31 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:27.560148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5a55-7acd-41b2-9337-92ab8893ff31 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:27.560361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5a55-7acd-41b2-9337-92ab8893ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:27.645594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4e6a5a55-7acd-41b2-9337-92ab8893ff31 None None] MFA Rules not processed for user `3f748dc73ef7444d9382a0680e027c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:27.646995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4e6a5a55-7acd-41b2-9337-92ab8893ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:27.669970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:27.734254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 487/987] 10.222.0.18 () {58 vars in 1061 bytes} [Sun Oct 23 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:27.744511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9090f4a-2800-4d46-a876-ad87f716254a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:27.746877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c9090f4a-2800-4d46-a876-ad87f716254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:27.864912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9090f4a-2800-4d46-a876-ad87f716254a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:27.943556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284e99-7470-4aa7-bce6-03e8c5d08d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:27.944170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284e99-7470-4aa7-bce6-03e8c5d08d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:27.944448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284e99-7470-4aa7-bce6-03e8c5d08d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:27.944720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284e99-7470-4aa7-bce6-03e8c5d08d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:27.946386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-43284e99-7470-4aa7-bce6-03e8c5d08d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:28.003812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:28.066532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43284e99-7470-4aa7-bce6-03e8c5d08d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:28.068013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43284e99-7470-4aa7-bce6-03e8c5d08d7c service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:28.090715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 501/988] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:30.568667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f761-7bfe-48e3-bfb3-4f08c203cac7 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:30.569173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f761-7bfe-48e3-bfb3-4f08c203cac7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:30.569173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f761-7bfe-48e3-bfb3-4f08c203cac7 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:30.570685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 488/989] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:30.576536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ec2a-c3fb-4e65-8efc-5b0d13eca13a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:30.576979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ec2a-c3fb-4e65-8efc-5b0d13eca13a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:30.577123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ec2a-c3fb-4e65-8efc-5b0d13eca13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:30.651518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f7d9ec2a-c3fb-4e65-8efc-5b0d13eca13a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:30.652744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f7d9ec2a-c3fb-4e65-8efc-5b0d13eca13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:30.748423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 502/990] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:31.035679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760f761-7bfe-48e3-bfb3-4f08c203cac7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:31.037321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3760f761-7bfe-48e3-bfb3-4f08c203cac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:31.158262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760f761-7bfe-48e3-bfb3-4f08c203cac7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:31.234760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:31.237622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01723a-d164-4cde-b6f2-35c782a5b88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:31.238465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01723a-d164-4cde-b6f2-35c782a5b88d service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:31.238766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01723a-d164-4cde-b6f2-35c782a5b88d service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:31.239191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01723a-d164-4cde-b6f2-35c782a5b88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:31.241078 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1d01723a-d164-4cde-b6f2-35c782a5b88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:31.353943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01723a-d164-4cde-b6f2-35c782a5b88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:31.355415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01723a-d164-4cde-b6f2-35c782a5b88d service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:31.374216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 489/991] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:33.879228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e150d-b068-4fcf-854b-de89cd63d488 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:33.879730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e150d-b068-4fcf-854b-de89cd63d488 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:33.879730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e150d-b068-4fcf-854b-de89cd63d488 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:33.881032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 503/992] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:33.886419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7630-3a54-4737-99e7-e7c1ba8ceb7d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:33.886884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7630-3a54-4737-99e7-e7c1ba8ceb7d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:33.886984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7630-3a54-4737-99e7-e7c1ba8ceb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:33.952372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-577b7630-3a54-4737-99e7-e7c1ba8ceb7d None None] MFA Rules not processed for user `dad3fdbccbf74642b4315d81d91ffd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:33.953581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-577b7630-3a54-4737-99e7-e7c1ba8ceb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:34.004645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:34.048286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 490/993] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:34.336507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e150d-b068-4fcf-854b-de89cd63d488 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:34.338131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-034e150d-b068-4fcf-854b-de89cd63d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:34.347747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:34.440794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e150d-b068-4fcf-854b-de89cd63d488 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:34.512674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e293ac-345d-42d3-94ff-578de7238307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:34.513259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e293ac-345d-42d3-94ff-578de7238307 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:34.513531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e293ac-345d-42d3-94ff-578de7238307 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:34.513794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e293ac-345d-42d3-94ff-578de7238307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:34.515404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d7e293ac-345d-42d3-94ff-578de7238307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:34.574908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:34.622689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e293ac-345d-42d3-94ff-578de7238307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:34.624116 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e293ac-345d-42d3-94ff-578de7238307 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:34.641470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 504/994] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:37.340679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5a75-1595-4c99-9e6e-bdee8ff1dcf3 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:37.341237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5a75-1595-4c99-9e6e-bdee8ff1dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:37.341237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5a75-1595-4c99-9e6e-bdee8ff1dcf3 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:37.342610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 491/995] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:37.347809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e8b4-d23e-4d81-9406-6ddb7ffeb0bb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:37.348266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e8b4-d23e-4d81-9406-6ddb7ffeb0bb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:37.348360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e8b4-d23e-4d81-9406-6ddb7ffeb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:37.412398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-eb45e8b4-d23e-4d81-9406-6ddb7ffeb0bb None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:37.413591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eb45e8b4-d23e-4d81-9406-6ddb7ffeb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:37.507032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 505/996] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:37.807305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44edc-3439-484d-8e24-161060bcbc63 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:37.807585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44edc-3439-484d-8e24-161060bcbc63 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:37.807858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44edc-3439-484d-8e24-161060bcbc63 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:37.809208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 492/997] 10.222.0.18 () {54 vars in 964 bytes} [Sun Oct 23 19:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:37.814983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae7b9-5822-47fb-a3cc-7d0766cb63e0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:37.815526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae7b9-5822-47fb-a3cc-7d0766cb63e0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:37.815800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae7b9-5822-47fb-a3cc-7d0766cb63e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:37.837577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:37.902934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9afae7b9-5822-47fb-a3cc-7d0766cb63e0 None None] MFA Rules not processed for user `3f748dc73ef7444d9382a0680e027c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:37.904063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9afae7b9-5822-47fb-a3cc-7d0766cb63e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:37.978874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 506/998] 10.222.0.18 () {58 vars in 1061 bytes} [Sun Oct 23 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:37.987997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44edc-3439-484d-8e24-161060bcbc63 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:37.989513 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6ca44edc-3439-484d-8e24-161060bcbc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:38.093129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44edc-3439-484d-8e24-161060bcbc63 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:38.166050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115818fe-c051-4d59-be4b-343a131d67a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:38.166997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115818fe-c051-4d59-be4b-343a131d67a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:38.167276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115818fe-c051-4d59-be4b-343a131d67a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:38.167546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115818fe-c051-4d59-be4b-343a131d67a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:38.169112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-115818fe-c051-4d59-be4b-343a131d67a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:38.175774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:38.279010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115818fe-c051-4d59-be4b-343a131d67a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:38.280615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115818fe-c051-4d59-be4b-343a131d67a2 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:38.298718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 493/999] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:41.595126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f7d15-1d08-4b85-82b4-f3f1cac51339 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:41.595654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f7d15-1d08-4b85-82b4-f3f1cac51339 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:41.595654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f7d15-1d08-4b85-82b4-f3f1cac51339 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:41.596997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 507/1000] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:41.602215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba0552-39b7-42ce-9394-db62346e7050 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:41.602618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba0552-39b7-42ce-9394-db62346e7050 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:41.603596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba0552-39b7-42ce-9394-db62346e7050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:41.671585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bfba0552-39b7-42ce-9394-db62346e7050 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:41.672796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bfba0552-39b7-42ce-9394-db62346e7050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:41.735597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:41.782429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 494/1001] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:42.079353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f7d15-1d08-4b85-82b4-f3f1cac51339 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:42.080921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a86f7d15-1d08-4b85-82b4-f3f1cac51339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:42.188831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f7d15-1d08-4b85-82b4-f3f1cac51339 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:42.202720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:42.265969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9913f74-b328-47a9-8dab-7e70836d95db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:42.266755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913f74-b328-47a9-8dab-7e70836d95db service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:42.267110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913f74-b328-47a9-8dab-7e70836d95db service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:42.267536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913f74-b328-47a9-8dab-7e70836d95db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:42.269702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a9913f74-b328-47a9-8dab-7e70836d95db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:42.380972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9913f74-b328-47a9-8dab-7e70836d95db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:42.382645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9913f74-b328-47a9-8dab-7e70836d95db service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:42.402146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 508/1002] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:44.622232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b754e-bef3-4775-9962-ad1d16da8125 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:44.622777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b754e-bef3-4775-9962-ad1d16da8125 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:44.622777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b754e-bef3-4775-9962-ad1d16da8125 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:44.624147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 495/1003] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:44.629997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fc3d-655e-4512-a705-3680145948b8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:44.630582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fc3d-655e-4512-a705-3680145948b8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:44.630582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fc3d-655e-4512-a705-3680145948b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:44.683568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:44.703302 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0df4fc3d-655e-4512-a705-3680145948b8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:44.704523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0df4fc3d-655e-4512-a705-3680145948b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:44.800630 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 509/1004] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:45.085491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b754e-bef3-4775-9962-ad1d16da8125 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:45.087062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-769b754e-bef3-4775-9962-ad1d16da8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:45.194629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b754e-bef3-4775-9962-ad1d16da8125 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:45.270450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934e2b4-92e8-4f2e-8508-51e4a79d83a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:45.271048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934e2b4-92e8-4f2e-8508-51e4a79d83a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:45.271327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934e2b4-92e8-4f2e-8508-51e4a79d83a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:45.271603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934e2b4-92e8-4f2e-8508-51e4a79d83a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:45.273201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3934e2b4-92e8-4f2e-8508-51e4a79d83a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:45.289953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:45.383456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934e2b4-92e8-4f2e-8508-51e4a79d83a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:45.385201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934e2b4-92e8-4f2e-8508-51e4a79d83a4 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:45.403766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 496/1005] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:47.645826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854636-3f69-4e27-b5cc-34fc1026f621 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:47.646373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854636-3f69-4e27-b5cc-34fc1026f621 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:47.646474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72854636-3f69-4e27-b5cc-34fc1026f621 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:47.647823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 510/1006] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:47.653763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dbbbc-ead6-449c-97d8-a19663afb225 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:47.654299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dbbbc-ead6-449c-97d8-a19663afb225 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:47.654452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dbbbc-ead6-449c-97d8-a19663afb225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:47.719881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-191dbbbc-ead6-449c-97d8-a19663afb225 None None] MFA Rules not processed for user `dad3fdbccbf74642b4315d81d91ffd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:47.721046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-191dbbbc-ead6-449c-97d8-a19663afb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:47.787195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:47.819521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 497/1007] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 19:57:48.111594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854636-3f69-4e27-b5cc-34fc1026f621 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:48.113111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-72854636-3f69-4e27-b5cc-34fc1026f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:48.222806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72854636-3f69-4e27-b5cc-34fc1026f621 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:48.243449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:48.299385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6164e-b1e3-4eb2-b7ba-d41f57f16904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:48.299900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6164e-b1e3-4eb2-b7ba-d41f57f16904 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:48.300177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6164e-b1e3-4eb2-b7ba-d41f57f16904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:48.300444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6164e-b1e3-4eb2-b7ba-d41f57f16904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:48.302019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5fa6164e-b1e3-4eb2-b7ba-d41f57f16904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:48.421836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6164e-b1e3-4eb2-b7ba-d41f57f16904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:48.423322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6164e-b1e3-4eb2-b7ba-d41f57f16904 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:48.442147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 511/1008] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:50.842721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b396-53b9-42ec-9ddb-ac571fd0ac15 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:50.843241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b396-53b9-42ec-9ddb-ac571fd0ac15 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:50.843335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b396-53b9-42ec-9ddb-ac571fd0ac15 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:50.844616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 498/1009] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:50.850141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa976-c5cd-4193-b841-d99d8895e3f6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:50.850539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa976-c5cd-4193-b841-d99d8895e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:50.850693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fa976-c5cd-4193-b841-d99d8895e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:50.914538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:50.918481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-945fa976-c5cd-4193-b841-d99d8895e3f6 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:50.919848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-945fa976-c5cd-4193-b841-d99d8895e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:51.015597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 512/1010] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:51.304988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7b396-53b9-42ec-9ddb-ac571fd0ac15 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:51.307148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d3f7b396-53b9-42ec-9ddb-ac571fd0ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:51.408489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7b396-53b9-42ec-9ddb-ac571fd0ac15 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:51.482776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ba843-c0f5-435c-bded-f69b8ae66451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:51.483372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ba843-c0f5-435c-bded-f69b8ae66451 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:51.483652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ba843-c0f5-435c-bded-f69b8ae66451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:51.483926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ba843-c0f5-435c-bded-f69b8ae66451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:51.485508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-970ba843-c0f5-435c-bded-f69b8ae66451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:51.511646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:51.592440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ba843-c0f5-435c-bded-f69b8ae66451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:51.593853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ba843-c0f5-435c-bded-f69b8ae66451 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:51.612373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 499/1011] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:53.854911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c5a4-10ef-42eb-8e36-aedb376c4fc3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:53.855416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c5a4-10ef-42eb-8e36-aedb376c4fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:53.855503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c5a4-10ef-42eb-8e36-aedb376c4fc3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:53.856804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 513/1012] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:53.861921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a677e-ac9c-48eb-a025-e7aadae63280 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:53.862353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a677e-ac9c-48eb-a025-e7aadae63280 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:53.862532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a677e-ac9c-48eb-a025-e7aadae63280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:53.927496 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-941a677e-ac9c-48eb-a025-e7aadae63280 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:53.928694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-941a677e-ac9c-48eb-a025-e7aadae63280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:54.003799 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:54.026626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 500/1013] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:54.310831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42c5a4-10ef-42eb-8e36-aedb376c4fc3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:54.312391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-be42c5a4-10ef-42eb-8e36-aedb376c4fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:54.414791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42c5a4-10ef-42eb-8e36-aedb376c4fc3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:54.443396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:54.489763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba44363-7aca-4c1b-b02e-d13b2bb8bd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:54.490397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44363-7aca-4c1b-b02e-d13b2bb8bd72 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:54.490674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44363-7aca-4c1b-b02e-d13b2bb8bd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:54.490942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44363-7aca-4c1b-b02e-d13b2bb8bd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:54.492557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4ba44363-7aca-4c1b-b02e-d13b2bb8bd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:54.596757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44363-7aca-4c1b-b02e-d13b2bb8bd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:54.598206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44363-7aca-4c1b-b02e-d13b2bb8bd72 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:54.616981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 514/1014] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:57:57.200958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b273-ea4d-4ab6-a9f5-9f44ca9330fe None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:57.201447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b273-ea4d-4ab6-a9f5-9f44ca9330fe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:57.201573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b273-ea4d-4ab6-a9f5-9f44ca9330fe None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:57.202924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 501/1015] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:57:57.208027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c694-9687-49b2-a60c-292d86187445 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:57.208435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c694-9687-49b2-a60c-292d86187445 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:57.208603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203c694-9687-49b2-a60c-292d86187445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:57.275914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0203c694-9687-49b2-a60c-292d86187445 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:57:57.277124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0203c694-9687-49b2-a60c-292d86187445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:57.285599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:57.372847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 515/1016] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:57:57.657874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b273-ea4d-4ab6-a9f5-9f44ca9330fe None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:57:57.659436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a4e2b273-ea4d-4ab6-a9f5-9f44ca9330fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:57.761364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b273-ea4d-4ab6-a9f5-9f44ca9330fe None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:57:57.833999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28303fad-7257-4379-aded-2f6aa669dbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:57:57.834622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303fad-7257-4379-aded-2f6aa669dbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:57:57.834902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303fad-7257-4379-aded-2f6aa669dbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:57:57.835172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303fad-7257-4379-aded-2f6aa669dbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:57:57.836746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-28303fad-7257-4379-aded-2f6aa669dbd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:57:57.872605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:57:57.945611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28303fad-7257-4379-aded-2f6aa669dbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:57:57.947165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28303fad-7257-4379-aded-2f6aa669dbd7 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:57:57.965349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 502/1017] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:02.012408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea38a7-bee2-4ce5-9317-065f9a8b52f2 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:02.012915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea38a7-bee2-4ce5-9317-065f9a8b52f2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:02.012915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea38a7-bee2-4ce5-9317-065f9a8b52f2 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:02.014358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 516/1018] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:02.019559 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187759d4-f124-4780-b0c1-1ca86aaa9479 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:02.019967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187759d4-f124-4780-b0c1-1ca86aaa9479 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:02.020116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187759d4-f124-4780-b0c1-1ca86aaa9479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:02.091720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-187759d4-f124-4780-b0c1-1ca86aaa9479 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:02.092931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-187759d4-f124-4780-b0c1-1ca86aaa9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:02.178901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:02.191199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 503/1019] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:02.476948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea38a7-bee2-4ce5-9317-065f9a8b52f2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:02.479315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-15ea38a7-bee2-4ce5-9317-065f9a8b52f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:02.581564 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea38a7-bee2-4ce5-9317-065f9a8b52f2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:02.622455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:02.659618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d3770-c666-42df-9002-a3746ebd6e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:02.660218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3770-c666-42df-9002-a3746ebd6e2e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:02.660494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3770-c666-42df-9002-a3746ebd6e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:02.660760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3770-c666-42df-9002-a3746ebd6e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:02.662360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4e6d3770-c666-42df-9002-a3746ebd6e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:02.773930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d3770-c666-42df-9002-a3746ebd6e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:02.775447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d3770-c666-42df-9002-a3746ebd6e2e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:02.794211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 517/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:05.562788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeb0b6-d30a-45d0-a619-fa7c8ccc16eb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:05.563290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeb0b6-d30a-45d0-a619-fa7c8ccc16eb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:05.563290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeb0b6-d30a-45d0-a619-fa7c8ccc16eb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:05.564583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 504/1021] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:05.569973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77820f-623c-4150-b2aa-84ec4361262c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:05.570385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77820f-623c-4150-b2aa-84ec4361262c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:05.570564 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77820f-623c-4150-b2aa-84ec4361262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:05.638426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8d77820f-623c-4150-b2aa-84ec4361262c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:05.639617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8d77820f-623c-4150-b2aa-84ec4361262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:05.658566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:05.738037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 518/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:06.025838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceeb0b6-d30a-45d0-a619-fa7c8ccc16eb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:06.027407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cceeb0b6-d30a-45d0-a619-fa7c8ccc16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:06.139408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceeb0b6-d30a-45d0-a619-fa7c8ccc16eb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:06.216913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86d014-c272-4d2f-b936-15e3b9487e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:06.217515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d014-c272-4d2f-b936-15e3b9487e4a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:06.217794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d014-c272-4d2f-b936-15e3b9487e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:06.218063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86d014-c272-4d2f-b936-15e3b9487e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:06.219667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6f86d014-c272-4d2f-b936-15e3b9487e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:06.264475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:06.334230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86d014-c272-4d2f-b936-15e3b9487e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:06.335666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86d014-c272-4d2f-b936-15e3b9487e4a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:06.354884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 505/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:10.856171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25337d3-870c-487d-ad30-a90b8caf65b0 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:10.856696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25337d3-870c-487d-ad30-a90b8caf65b0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:10.856796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25337d3-870c-487d-ad30-a90b8caf65b0 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:10.858099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 519/1024] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:10.863699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b556e8-83bf-4b2c-9209-6cf7f07ea504 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:10.864097 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b556e8-83bf-4b2c-9209-6cf7f07ea504 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:10.864266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b556e8-83bf-4b2c-9209-6cf7f07ea504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:10.934539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c3b556e8-83bf-4b2c-9209-6cf7f07ea504 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:10.935744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c3b556e8-83bf-4b2c-9209-6cf7f07ea504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:11.041522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:11.043989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 506/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 19:58:11.327869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25337d3-870c-487d-ad30-a90b8caf65b0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:11.329402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a25337d3-870c-487d-ad30-a90b8caf65b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:11.429977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25337d3-870c-487d-ad30-a90b8caf65b0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:11.478219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:11.503999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f7137-74c9-4524-a107-4a6349c50ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:11.504592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7137-74c9-4524-a107-4a6349c50ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:11.504874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7137-74c9-4524-a107-4a6349c50ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:11.505140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f7137-74c9-4524-a107-4a6349c50ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:11.506730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-379f7137-74c9-4524-a107-4a6349c50ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:11.614060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f7137-74c9-4524-a107-4a6349c50ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:11.615505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f7137-74c9-4524-a107-4a6349c50ef4 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:11.634215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 520/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:16.576856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ec5d1-36cf-45ef-af92-d047c7c5e395 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:16.577382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ec5d1-36cf-45ef-af92-d047c7c5e395 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:16.577382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ec5d1-36cf-45ef-af92-d047c7c5e395 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:16.579077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 507/1027] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 19:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:16.584170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b20347-2b5b-45dd-a4fd-0f4c1b7b8095 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:16.584605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b20347-2b5b-45dd-a4fd-0f4c1b7b8095 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:16.584693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b20347-2b5b-45dd-a4fd-0f4c1b7b8095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:16.702606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c7b20347-2b5b-45dd-a4fd-0f4c1b7b8095 None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:16.703813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c7b20347-2b5b-45dd-a4fd-0f4c1b7b8095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:16.773378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:16.889687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 521/1028] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:21.045568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcedbd-6c47-4954-a37a-0810d2017f11 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:21.046064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcedbd-6c47-4954-a37a-0810d2017f11 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:21.046440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcedbd-6c47-4954-a37a-0810d2017f11 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:21.047681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 508/1029] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 19:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:21.052799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c59afd-d82e-4650-9d3c-7b27847cc0c4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:21.053619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c59afd-d82e-4650-9d3c-7b27847cc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:21.054169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c59afd-d82e-4650-9d3c-7b27847cc0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:21.158629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-56c59afd-d82e-4650-9d3c-7b27847cc0c4 None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:21.160011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-56c59afd-d82e-4650-9d3c-7b27847cc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:21.238274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:21.276569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 522/1030] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:22.703724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51380949-c10b-429f-a29d-d6ed221ff4f2 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:22.704236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51380949-c10b-429f-a29d-d6ed221ff4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:22.704518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51380949-c10b-429f-a29d-d6ed221ff4f2 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:22.706028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 509/1031] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 19:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:22.711223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015209d6-8489-4bc9-b928-2a0223928725 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:22.711606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015209d6-8489-4bc9-b928-2a0223928725 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:22.712348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015209d6-8489-4bc9-b928-2a0223928725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:22.790182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-015209d6-8489-4bc9-b928-2a0223928725 None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:22.791750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-015209d6-8489-4bc9-b928-2a0223928725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:22.901991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 523/1032] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 19:58:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 19:58:26.379729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658cdd6-e176-40b1-b541-94f9a67520a3 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:26.380239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658cdd6-e176-40b1-b541-94f9a67520a3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:26.380347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658cdd6-e176-40b1-b541-94f9a67520a3 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:26.381601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 510/1033] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:26.387828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03584e-e0fa-4097-b396-915698fb9bd2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:26.388257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03584e-e0fa-4097-b396-915698fb9bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:26.388378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03584e-e0fa-4097-b396-915698fb9bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:26.431532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:26.466325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-da03584e-e0fa-4097-b396-915698fb9bd2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:26.467743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-da03584e-e0fa-4097-b396-915698fb9bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:26.572034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 524/1034] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:26.872602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a870d-b027-4993-8266-ad3c9efeba21 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:26.872889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a870d-b027-4993-8266-ad3c9efeba21 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:26.873161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a870d-b027-4993-8266-ad3c9efeba21 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:26.874758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 511/1035] 10.222.0.18 () {54 vars in 961 bytes} [Sun Oct 23 19:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:26.884221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc844f4-d581-482b-9dd2-c2cab92cbceb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:26.884891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc844f4-d581-482b-9dd2-c2cab92cbceb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:26.885337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc844f4-d581-482b-9dd2-c2cab92cbceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:26.972260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4dc844f4-d581-482b-9dd2-c2cab92cbceb None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:26.973956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4dc844f4-d581-482b-9dd2-c2cab92cbceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:27.027448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:27.099694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 525/1036] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Oct 23 19:58:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 19:58:27.110579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a870d-b027-4993-8266-ad3c9efeba21 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:27.112167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-731a870d-b027-4993-8266-ad3c9efeba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:27.270172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a870d-b027-4993-8266-ad3c9efeba21 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:27.362602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:27.404208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063820b-be80-4b01-bb97-96d63112e3c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:27.404841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063820b-be80-4b01-bb97-96d63112e3c8 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:27.405096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063820b-be80-4b01-bb97-96d63112e3c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:27.405346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063820b-be80-4b01-bb97-96d63112e3c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:27.406940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d063820b-be80-4b01-bb97-96d63112e3c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:27.507126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063820b-be80-4b01-bb97-96d63112e3c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:27.508780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063820b-be80-4b01-bb97-96d63112e3c8 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:27.529012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 512/1037] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:29.922756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a1d50-7358-49ef-b4ce-f86733a7317c None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:29.922756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a1d50-7358-49ef-b4ce-f86733a7317c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:29.922756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a1d50-7358-49ef-b4ce-f86733a7317c None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:29.922756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 526/1038] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:29.927439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd407-5e0d-40f7-a001-14bd803024be None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:29.927900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd407-5e0d-40f7-a001-14bd803024be None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:29.927900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd407-5e0d-40f7-a001-14bd803024be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:29.999052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-233fd407-5e0d-40f7-a001-14bd803024be None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:30.000256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-233fd407-5e0d-40f7-a001-14bd803024be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:30.040247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:30.114206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 513/1039] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:30.409358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a1d50-7358-49ef-b4ce-f86733a7317c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:30.411732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-317a1d50-7358-49ef-b4ce-f86733a7317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:30.594748 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a1d50-7358-49ef-b4ce-f86733a7317c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:30.610123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:30.736740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428808c8-6e02-460c-8667-b65cd6fd5312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:30.737490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428808c8-6e02-460c-8667-b65cd6fd5312 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:30.737772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428808c8-6e02-460c-8667-b65cd6fd5312 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:30.738070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428808c8-6e02-460c-8667-b65cd6fd5312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:30.739880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-428808c8-6e02-460c-8667-b65cd6fd5312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:30.834733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428808c8-6e02-460c-8667-b65cd6fd5312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:30.836424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428808c8-6e02-460c-8667-b65cd6fd5312 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:30.855691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 527/1040] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:33.368556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee6ae-285a-4404-b0ba-2cff204378a7 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:33.369123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee6ae-285a-4404-b0ba-2cff204378a7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:33.369123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee6ae-285a-4404-b0ba-2cff204378a7 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:33.370476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 514/1041] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:33.376091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82036-4783-4394-8a75-7328723f91ae None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:33.376492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82036-4783-4394-8a75-7328723f91ae None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:33.376584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf82036-4783-4394-8a75-7328723f91ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:33.393390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:33.449159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3bf82036-4783-4394-8a75-7328723f91ae None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:33.450393 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3bf82036-4783-4394-8a75-7328723f91ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:33.556643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 528/1042] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:33.846514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48795b-959c-464e-b886-d0aae480b240 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:33.846809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48795b-959c-464e-b886-d0aae480b240 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:33.847127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48795b-959c-464e-b886-d0aae480b240 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:33.848660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 515/1043] 10.222.0.18 () {54 vars in 961 bytes} [Sun Oct 23 19:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:33.854556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bf134-2422-4b5f-916b-72a16481b561 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:33.855030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bf134-2422-4b5f-916b-72a16481b561 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:33.855381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bf134-2422-4b5f-916b-72a16481b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:33.937215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-485bf134-2422-4b5f-916b-72a16481b561 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:33.938451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-485bf134-2422-4b5f-916b-72a16481b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:33.974807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:34.062700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 529/1044] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Oct 23 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:34.072224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48795b-959c-464e-b886-d0aae480b240 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:34.074355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5e48795b-959c-464e-b886-d0aae480b240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:34.237233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48795b-959c-464e-b886-d0aae480b240 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:34.265763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:34.373932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e8f87-97ea-4b6b-b815-ed1b68ca3275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:34.374622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e8f87-97ea-4b6b-b815-ed1b68ca3275 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:34.374851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e8f87-97ea-4b6b-b815-ed1b68ca3275 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:34.375124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e8f87-97ea-4b6b-b815-ed1b68ca3275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:34.376750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c62e8f87-97ea-4b6b-b815-ed1b68ca3275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:34.474099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e8f87-97ea-4b6b-b815-ed1b68ca3275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:34.475793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e8f87-97ea-4b6b-b815-ed1b68ca3275 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:34.498225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 516/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 19:58:34.608296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1ba79-77b8-4141-86e9-fcf93ec61869 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:34.608711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1ba79-77b8-4141-86e9-fcf93ec61869 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:34.608805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1ba79-77b8-4141-86e9-fcf93ec61869 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:34.614107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 530/1046] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:34.615630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22226-ad5b-46c0-bdf9-74f7cc3e1b47 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:34.615939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22226-ad5b-46c0-bdf9-74f7cc3e1b47 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:34.616260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22226-ad5b-46c0-bdf9-74f7cc3e1b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:34.656397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:34.707128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-22f22226-ad5b-46c0-bdf9-74f7cc3e1b47 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:34.708527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-22f22226-ad5b-46c0-bdf9-74f7cc3e1b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:34.834134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 517/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 19:58:35.135807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab314-79d6-4152-8ba0-fa4f2b9ffd91 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:35.136212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab314-79d6-4152-8ba0-fa4f2b9ffd91 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:35.136549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab314-79d6-4152-8ba0-fa4f2b9ffd91 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:35.138171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 531/1048] 10.222.0.18 () {54 vars in 963 bytes} [Sun Oct 23 19:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:35.143009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20963-561a-4fde-886c-c4b480c00074 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:35.143297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20963-561a-4fde-886c-c4b480c00074 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:35.143570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae20963-561a-4fde-886c-c4b480c00074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:35.223290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5ae20963-561a-4fde-886c-c4b480c00074 None None] MFA Rules not processed for user `201521dc87e544c0afcee0f7a7d0af7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:35.224507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5ae20963-561a-4fde-886c-c4b480c00074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:35.275303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:35.307550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 518/1049] 10.222.0.18 () {58 vars in 1060 bytes} [Sun Oct 23 19:58:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:35.315206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab314-79d6-4152-8ba0-fa4f2b9ffd91 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:35.316993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-66aab314-79d6-4152-8ba0-fa4f2b9ffd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:35.433943 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab314-79d6-4152-8ba0-fa4f2b9ffd91 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:35.481186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:35.535232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027f209-ad82-4a44-bf1e-0da266f43573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:35.536305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f209-ad82-4a44-bf1e-0da266f43573 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:35.536725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f209-ad82-4a44-bf1e-0da266f43573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:35.537189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f209-ad82-4a44-bf1e-0da266f43573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:35.539366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c027f209-ad82-4a44-bf1e-0da266f43573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:35.695723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027f209-ad82-4a44-bf1e-0da266f43573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:35.698346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027f209-ad82-4a44-bf1e-0da266f43573 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:35.726693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 532/1050] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:36.798773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad807-2604-48dd-81e9-4a7ca2030e0b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:36.799304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad807-2604-48dd-81e9-4a7ca2030e0b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:36.799304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad807-2604-48dd-81e9-4a7ca2030e0b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:36.800642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 519/1051] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:36.806872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9f7b-f550-475e-9b7d-6bbb1c452dc7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:36.807289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9f7b-f550-475e-9b7d-6bbb1c452dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:36.807425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9f7b-f550-475e-9b7d-6bbb1c452dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:36.873874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-351a9f7b-f550-475e-9b7d-6bbb1c452dc7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:36.875113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-351a9f7b-f550-475e-9b7d-6bbb1c452dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:36.896439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:36.975245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 533/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:37.268942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad807-2604-48dd-81e9-4a7ca2030e0b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:37.271058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-154ad807-2604-48dd-81e9-4a7ca2030e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:37.432692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad807-2604-48dd-81e9-4a7ca2030e0b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:37.488261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:37.551816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4640b-5cac-46bd-89f7-ace6b01b121c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:37.552414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4640b-5cac-46bd-89f7-ace6b01b121c service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:37.552693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4640b-5cac-46bd-89f7-ace6b01b121c service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:37.552971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4640b-5cac-46bd-89f7-ace6b01b121c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:37.554598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b2b4640b-5cac-46bd-89f7-ace6b01b121c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:37.657204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4640b-5cac-46bd-89f7-ace6b01b121c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:37.658993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4640b-5cac-46bd-89f7-ace6b01b121c service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:37.678069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 520/1053] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:39.917586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408164-0473-4c08-ab4f-0102c39e8bc0 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:39.918175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408164-0473-4c08-ab4f-0102c39e8bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:39.918483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408164-0473-4c08-ab4f-0102c39e8bc0 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:39.919839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 534/1054] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:39.925657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d24d0-4b0b-4811-b94b-d3e162ce72e2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:39.926327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d24d0-4b0b-4811-b94b-d3e162ce72e2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:39.926327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d24d0-4b0b-4811-b94b-d3e162ce72e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:39.996529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-016d24d0-4b0b-4811-b94b-d3e162ce72e2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:39.997735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-016d24d0-4b0b-4811-b94b-d3e162ce72e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:40.005054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:40.122563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 521/1055] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:40.451341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14408164-0473-4c08-ab4f-0102c39e8bc0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:40.453206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-14408164-0473-4c08-ab4f-0102c39e8bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:40.657301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14408164-0473-4c08-ab4f-0102c39e8bc0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:40.661518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:40.816949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cebe54-ee17-4639-b284-29d9c1cf2b7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:40.817648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebe54-ee17-4639-b284-29d9c1cf2b7d service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:40.817932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebe54-ee17-4639-b284-29d9c1cf2b7d service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:40.818480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebe54-ee17-4639-b284-29d9c1cf2b7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:40.820159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e2cebe54-ee17-4639-b284-29d9c1cf2b7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:40.939246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cebe54-ee17-4639-b284-29d9c1cf2b7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:40.940757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cebe54-ee17-4639-b284-29d9c1cf2b7d service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:40.964648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 535/1056] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:43.199939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a61e-debe-48cb-8063-bcaa129c2eb5 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:43.200372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a61e-debe-48cb-8063-bcaa129c2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:43.200597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a61e-debe-48cb-8063-bcaa129c2eb5 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:43.201826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 522/1057] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:43.207256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01148ef-d3d1-4f9b-a9f8-ef0d7567e8fa None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:43.207656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01148ef-d3d1-4f9b-a9f8-ef0d7567e8fa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:43.207939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01148ef-d3d1-4f9b-a9f8-ef0d7567e8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:43.220540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:43.284722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f01148ef-d3d1-4f9b-a9f8-ef0d7567e8fa None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:43.285907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f01148ef-d3d1-4f9b-a9f8-ef0d7567e8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:43.419377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 536/1058] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:43.757114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241a61e-debe-48cb-8063-bcaa129c2eb5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:43.759410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1241a61e-debe-48cb-8063-bcaa129c2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:43.910675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:43.921986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241a61e-debe-48cb-8063-bcaa129c2eb5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:44.041851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0bc2-1cc4-40aa-8320-4da498d7c979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:44.042455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0bc2-1cc4-40aa-8320-4da498d7c979 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:44.042740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0bc2-1cc4-40aa-8320-4da498d7c979 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:44.043029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0bc2-1cc4-40aa-8320-4da498d7c979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:44.044711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6a8a0bc2-1cc4-40aa-8320-4da498d7c979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:44.140656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a0bc2-1cc4-40aa-8320-4da498d7c979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:44.142447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a0bc2-1cc4-40aa-8320-4da498d7c979 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:44.154027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:44.163749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 523/1059] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:46.370926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5785e-5166-4908-ba2d-357c75a51ed6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:46.371485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5785e-5166-4908-ba2d-357c75a51ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:46.371485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5785e-5166-4908-ba2d-357c75a51ed6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:46.373376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 537/1060] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:46.379515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb9c7-54a6-4bee-945c-d61ab9b17c50 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:46.379938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb9c7-54a6-4bee-945c-d61ab9b17c50 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:46.380074 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb9c7-54a6-4bee-945c-d61ab9b17c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:46.455523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c99cb9c7-54a6-4bee-945c-d61ab9b17c50 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:46.456738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c99cb9c7-54a6-4bee-945c-d61ab9b17c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:46.565988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 524/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:46.862846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5785e-5166-4908-ba2d-357c75a51ed6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:46.864862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3fd5785e-5166-4908-ba2d-357c75a51ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:46.967252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:47.039179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5785e-5166-4908-ba2d-357c75a51ed6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:47.179687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe7b2b-55b3-47d0-bb9d-0308165c1f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:47.180242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7b2b-55b3-47d0-bb9d-0308165c1f9d service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:47.181016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7b2b-55b3-47d0-bb9d-0308165c1f9d service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:47.181301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7b2b-55b3-47d0-bb9d-0308165c1f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:47.182981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5fe7b2b-55b3-47d0-bb9d-0308165c1f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:47.242207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:47.285524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe7b2b-55b3-47d0-bb9d-0308165c1f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:47.287183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe7b2b-55b3-47d0-bb9d-0308165c1f9d service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:47.305270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 538/1062] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:49.580013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53f3a-7cc6-4204-9ba8-6cb536c81e16 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:49.580583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53f3a-7cc6-4204-9ba8-6cb536c81e16 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:49.580583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53f3a-7cc6-4204-9ba8-6cb536c81e16 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:49.582342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 525/1063] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:49.588054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d103a-0305-47a8-8bfc-58e88803ab7a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:49.588457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d103a-0305-47a8-8bfc-58e88803ab7a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:49.588653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d103a-0305-47a8-8bfc-58e88803ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:49.657828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-971d103a-0305-47a8-8bfc-58e88803ab7a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:49.659083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-971d103a-0305-47a8-8bfc-58e88803ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:49.755359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 539/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:50.048120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e53f3a-7cc6-4204-9ba8-6cb536c81e16 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:50.049639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-65e53f3a-7cc6-4204-9ba8-6cb536c81e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:50.127931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:50.199953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e53f3a-7cc6-4204-9ba8-6cb536c81e16 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:50.312510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f39a5b-4cfc-4827-b1c2-7361ca167102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:50.313109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39a5b-4cfc-4827-b1c2-7361ca167102 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:50.313389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39a5b-4cfc-4827-b1c2-7361ca167102 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:50.313660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39a5b-4cfc-4827-b1c2-7361ca167102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:50.315256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a2f39a5b-4cfc-4827-b1c2-7361ca167102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:50.354691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:50.410600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f39a5b-4cfc-4827-b1c2-7361ca167102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:50.412166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f39a5b-4cfc-4827-b1c2-7361ca167102 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:50.433122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 526/1065] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:51.148494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063e3f4-59e7-4390-bca0-06836f5885e7 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:51.149105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063e3f4-59e7-4390-bca0-06836f5885e7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:51.149279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063e3f4-59e7-4390-bca0-06836f5885e7 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:51.150575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 540/1066] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:51.155930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33d009-6a8f-44b9-a0b1-472c0277bf13 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:51.156352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33d009-6a8f-44b9-a0b1-472c0277bf13 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:51.156457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33d009-6a8f-44b9-a0b1-472c0277bf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:51.222329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9f33d009-6a8f-44b9-a0b1-472c0277bf13 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:51.223517 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9f33d009-6a8f-44b9-a0b1-472c0277bf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:51.322342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 527/1067] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:51.636230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59f9c-535f-462b-9340-4e9fbd53eb8f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:51.636518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59f9c-535f-462b-9340-4e9fbd53eb8f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:51.636797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59f9c-535f-462b-9340-4e9fbd53eb8f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:51.638283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 541/1068] 10.222.0.18 () {54 vars in 962 bytes} [Sun Oct 23 19:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:51.643482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5edf9-7a2f-45e6-8560-4a16fd8a9dfd None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:51.643772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5edf9-7a2f-45e6-8560-4a16fd8a9dfd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:51.644050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5edf9-7a2f-45e6-8560-4a16fd8a9dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:51.660463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:51.723110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-29f5edf9-7a2f-45e6-8560-4a16fd8a9dfd None None] MFA Rules not processed for user `d8c8ca8a1b1a4cffaf64bc0840b5fd02`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:51.724306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-29f5edf9-7a2f-45e6-8560-4a16fd8a9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:51.800897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 528/1069] 10.222.0.18 () {58 vars in 1059 bytes} [Sun Oct 23 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:51.808979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59f9c-535f-462b-9340-4e9fbd53eb8f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:51.810621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6ae59f9c-535f-462b-9340-4e9fbd53eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:51.842518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:51.914704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59f9c-535f-462b-9340-4e9fbd53eb8f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:51.989785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08a277-803d-4441-99f5-11a381af7d62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:51.990421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a277-803d-4441-99f5-11a381af7d62 service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:51.990700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a277-803d-4441-99f5-11a381af7d62 service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:51.990977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a277-803d-4441-99f5-11a381af7d62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:51.992545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6f08a277-803d-4441-99f5-11a381af7d62 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:52.070732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:52.103840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08a277-803d-4441-99f5-11a381af7d62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:52.105270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08a277-803d-4441-99f5-11a381af7d62 service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:52.124136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 542/1070] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:52.650869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4759-1d01-4712-88d9-42636bec41fe None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:52.651363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4759-1d01-4712-88d9-42636bec41fe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:52.651466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4759-1d01-4712-88d9-42636bec41fe None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:52.652772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 529/1071] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:52.658463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f565b6a-8e00-4a53-aa8e-702132d482ff None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:52.658954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f565b6a-8e00-4a53-aa8e-702132d482ff None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:52.659145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f565b6a-8e00-4a53-aa8e-702132d482ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:52.739006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2f565b6a-8e00-4a53-aa8e-702132d482ff None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:52.740242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2f565b6a-8e00-4a53-aa8e-702132d482ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:52.838707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 543/1072] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:52.888872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2909d3-9e7c-4dd7-bed0-8b5507e6c2a3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:52.889233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2909d3-9e7c-4dd7-bed0-8b5507e6c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:52.889591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2909d3-9e7c-4dd7-bed0-8b5507e6c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:52.957267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0b2909d3-9e7c-4dd7-bed0-8b5507e6c2a3 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:52.958568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0b2909d3-9e7c-4dd7-bed0-8b5507e6c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:53.014170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:53.046655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 530/1073] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 19:58:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:53.089738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273d87-b7ab-4a1b-80a1-590e1ac76057 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:53.090027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273d87-b7ab-4a1b-80a1-590e1ac76057 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:53.090337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01273d87-b7ab-4a1b-80a1-590e1ac76057 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:53.091682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 544/1074] 10.222.0.18 () {54 vars in 943 bytes} [Sun Oct 23 19:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:53.097894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5095-59c0-41bd-863f-1dfbc670b1b1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:53.098210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5095-59c0-41bd-863f-1dfbc670b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:53.098484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5095-59c0-41bd-863f-1dfbc670b1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:53.136606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01273d87-b7ab-4a1b-80a1-590e1ac76057 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:53.138025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-01273d87-b7ab-4a1b-80a1-590e1ac76057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:53.175598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cedd5095-59c0-41bd-863f-1dfbc670b1b1 None None] MFA Rules not processed for user `5ddd37ebc3874a8f8a8d60c0a32bf090`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:53.176798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cedd5095-59c0-41bd-863f-1dfbc670b1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:53.177843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:53.286293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 531/1075] 10.222.0.18 () {58 vars in 1040 bytes} [Sun Oct 23 19:58:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:53.288917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01273d87-b7ab-4a1b-80a1-590e1ac76057 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:53.296327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd5095-59c0-41bd-863f-1dfbc670b1b1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:53.306436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd5095-59c0-41bd-863f-1dfbc670b1b1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:53.332210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:53.406099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:53.408441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83757501-b92b-461f-968c-e735c41d906f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:53.409264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83757501-b92b-461f-968c-e735c41d906f service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:53.409705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83757501-b92b-461f-968c-e735c41d906f service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:53.410251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83757501-b92b-461f-968c-e735c41d906f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:53.411871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-83757501-b92b-461f-968c-e735c41d906f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:53.411989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92953e4b-df90-4e06-b73d-0c5bacf85166 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:53.412546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953e4b-df90-4e06-b73d-0c5bacf85166 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:53.412822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953e4b-df90-4e06-b73d-0c5bacf85166 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:53.413090 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953e4b-df90-4e06-b73d-0c5bacf85166 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:53.415208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-92953e4b-df90-4e06-b73d-0c5bacf85166 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:53.501871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92953e4b-df90-4e06-b73d-0c5bacf85166 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:53.503497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92953e4b-df90-4e06-b73d-0c5bacf85166 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:53.503836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83757501-b92b-461f-968c-e735c41d906f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:53.505408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83757501-b92b-461f-968c-e735c41d906f service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:53.512120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 532/1076] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 19:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 19:58:53.524980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 545/1077] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:55.790571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f30409-6955-4d98-825a-a950a6cb7b07 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:55.791151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f30409-6955-4d98-825a-a950a6cb7b07 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:55.791151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f30409-6955-4d98-825a-a950a6cb7b07 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:55.792653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 533/1078] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:55.797797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783e165-9020-4e31-9440-0bb3f6520c0c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:55.798245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783e165-9020-4e31-9440-0bb3f6520c0c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:55.798429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783e165-9020-4e31-9440-0bb3f6520c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:55.870540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8783e165-9020-4e31-9440-0bb3f6520c0c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:55.871708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8783e165-9020-4e31-9440-0bb3f6520c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:55.955359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:55.986715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 546/1079] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:56.293514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f30409-6955-4d98-825a-a950a6cb7b07 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:56.294221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-32f30409-6955-4d98-825a-a950a6cb7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:56.396067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:56.496156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f30409-6955-4d98-825a-a950a6cb7b07 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:56.625353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57407354-1bc1-4c51-b584-c6aee3af15ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:56.625967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57407354-1bc1-4c51-b584-c6aee3af15ea service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:56.626295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57407354-1bc1-4c51-b584-c6aee3af15ea service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:56.626571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57407354-1bc1-4c51-b584-c6aee3af15ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:56.628168 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-57407354-1bc1-4c51-b584-c6aee3af15ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:56.653053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:56.733630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57407354-1bc1-4c51-b584-c6aee3af15ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:56.735253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57407354-1bc1-4c51-b584-c6aee3af15ea service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:56.755657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 534/1080] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:58:59.030435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea35-83f1-4fe7-95cb-8010e08c4ff7 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:59.031017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea35-83f1-4fe7-95cb-8010e08c4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:59.031017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ea35-83f1-4fe7-95cb-8010e08c4ff7 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:59.032297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 547/1081] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:58:59.037571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecb4ec-565a-46e7-a175-8c1fade9fa68 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:59.037988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecb4ec-565a-46e7-a175-8c1fade9fa68 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:59.038171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecb4ec-565a-46e7-a175-8c1fade9fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:59.117192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-15ecb4ec-565a-46e7-a175-8c1fade9fa68 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:58:59.118652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-15ecb4ec-565a-46e7-a175-8c1fade9fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:59.220728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:59.228051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 535/1082] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:58:59.525887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ea35-83f1-4fe7-95cb-8010e08c4ff7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:58:59.527721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-aec0ea35-83f1-4fe7-95cb-8010e08c4ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:59.697995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ea35-83f1-4fe7-95cb-8010e08c4ff7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:58:59.755136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:58:59.822320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ca707-3af6-437e-b15e-d703dee995e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:58:59.822848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca707-3af6-437e-b15e-d703dee995e1 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:58:59.823138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca707-3af6-437e-b15e-d703dee995e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:58:59.823403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ca707-3af6-437e-b15e-d703dee995e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:58:59.825048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-533ca707-3af6-437e-b15e-d703dee995e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:58:59.927284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ca707-3af6-437e-b15e-d703dee995e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:58:59.928908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ca707-3af6-437e-b15e-d703dee995e1 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:58:59.949028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 548/1083] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:02.251427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e420fb-0069-44f1-9eae-67b1ab3ad3fc None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:02.251993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e420fb-0069-44f1-9eae-67b1ab3ad3fc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:02.252224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e420fb-0069-44f1-9eae-67b1ab3ad3fc None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:02.253664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 536/1084] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 19:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:02.259605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c468e8-f504-4e7d-9726-890968dbd8ea None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:02.260045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c468e8-f504-4e7d-9726-890968dbd8ea None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:02.260231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c468e8-f504-4e7d-9726-890968dbd8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:02.333763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b4c468e8-f504-4e7d-9726-890968dbd8ea None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:02.335005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b4c468e8-f504-4e7d-9726-890968dbd8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:02.348440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:02.458396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 549/1085] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:02.748315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e420fb-0069-44f1-9eae-67b1ab3ad3fc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:02.749846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-76e420fb-0069-44f1-9eae-67b1ab3ad3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:02.919985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e420fb-0069-44f1-9eae-67b1ab3ad3fc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:03.016329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:03.068766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f66fa-4219-4a75-a042-7270af324ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:03.069684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f66fa-4219-4a75-a042-7270af324ab0 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:03.070154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f66fa-4219-4a75-a042-7270af324ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:03.070594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f66fa-4219-4a75-a042-7270af324ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:03.073332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ef3f66fa-4219-4a75-a042-7270af324ab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:03.171270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f66fa-4219-4a75-a042-7270af324ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:03.173226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f66fa-4219-4a75-a042-7270af324ab0 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:03.197421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 537/1086] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:12.444570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=38 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:13.194371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=64 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:16.272677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823d23-81a8-46ea-9854-2332bab0165b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:16.273243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823d23-81a8-46ea-9854-2332bab0165b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:16.273243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823d23-81a8-46ea-9854-2332bab0165b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:16.274612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 550/1087] 10.222.0.18 () {54 vars in 918 bytes} [Sun Oct 23 19:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:16.279847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902140d7-6a4f-4b5a-b107-c292df38b8d8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:16.280273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902140d7-6a4f-4b5a-b107-c292df38b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:16.280447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902140d7-6a4f-4b5a-b107-c292df38b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:16.355388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-902140d7-6a4f-4b5a-b107-c292df38b8d8 None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:16.356641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-902140d7-6a4f-4b5a-b107-c292df38b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:16.460851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 538/1088] 10.222.0.18 () {58 vars in 1015 bytes} [Sun Oct 23 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:16.475252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd880-2aa7-40e2-bf28-e4d55fa7b369 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:16.475537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd880-2aa7-40e2-bf28-e4d55fa7b369 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:16.475812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd880-2aa7-40e2-bf28-e4d55fa7b369 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:16.477255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 551/1089] 10.222.0.18 () {54 vars in 918 bytes} [Sun Oct 23 19:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:16.481926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454fb41-3da9-4107-81c6-9eecd6e130cd None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:16.482253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454fb41-3da9-4107-81c6-9eecd6e130cd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:16.482524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454fb41-3da9-4107-81c6-9eecd6e130cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:16.561703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:16.565078 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4454fb41-3da9-4107-81c6-9eecd6e130cd None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:16.566871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4454fb41-3da9-4107-81c6-9eecd6e130cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:16.686150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 539/1090] 10.222.0.18 () {58 vars in 1015 bytes} [Sun Oct 23 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 19:59:19.263680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7a55-9414-406a-8d09-e65584a241fd None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:19.264271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7a55-9414-406a-8d09-e65584a241fd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:19.264388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7a55-9414-406a-8d09-e65584a241fd None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:19.265684 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 552/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:19.270905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1fe96-8e49-43fc-98c2-0d6001022907 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:19.271345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1fe96-8e49-43fc-98c2-0d6001022907 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:19.271452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1fe96-8e49-43fc-98c2-0d6001022907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:19.341515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-28f1fe96-8e49-43fc-98c2-0d6001022907 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:19.342748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-28f1fe96-8e49-43fc-98c2-0d6001022907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:19.396067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:19.438388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 540/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:19.725768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d7a55-9414-406a-8d09-e65584a241fd None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:19.727832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a12d7a55-9414-406a-8d09-e65584a241fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:19.871791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d7a55-9414-406a-8d09-e65584a241fd None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:19.944016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:19.983894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f1e73-04e8-42bc-adf7-ccf3e4ddbce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:19.984498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1e73-04e8-42bc-adf7-ccf3e4ddbce2 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:19.984782 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1e73-04e8-42bc-adf7-ccf3e4ddbce2 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:19.985048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1e73-04e8-42bc-adf7-ccf3e4ddbce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:19.986654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3f5f1e73-04e8-42bc-adf7-ccf3e4ddbce2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:20.076176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f1e73-04e8-42bc-adf7-ccf3e4ddbce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:20.077751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f1e73-04e8-42bc-adf7-ccf3e4ddbce2 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:20.095156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 553/1093] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:21.228974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e8b4-4ff1-46ca-b0d6-3b7f3135ff28 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:21.229520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e8b4-4ff1-46ca-b0d6-3b7f3135ff28 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:21.229520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e8b4-4ff1-46ca-b0d6-3b7f3135ff28 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:21.230940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 541/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:21.235784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223e11-8736-4b9d-8bcf-d0f22930c80e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:21.236188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223e11-8736-4b9d-8bcf-d0f22930c80e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:21.236327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223e11-8736-4b9d-8bcf-d0f22930c80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:21.312909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ca223e11-8736-4b9d-8bcf-d0f22930c80e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:21.314126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ca223e11-8736-4b9d-8bcf-d0f22930c80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:21.340504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:21.409951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 554/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:21.558350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e8b4-4ff1-46ca-b0d6-3b7f3135ff28 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:21.559822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8765e8b4-4ff1-46ca-b0d6-3b7f3135ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:21.704682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e8b4-4ff1-46ca-b0d6-3b7f3135ff28 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:21.745062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:21.816460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf66ba-4b5c-4ff4-8710-83605f5e79b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:21.816980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf66ba-4b5c-4ff4-8710-83605f5e79b9 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:21.817512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf66ba-4b5c-4ff4-8710-83605f5e79b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:21.817784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf66ba-4b5c-4ff4-8710-83605f5e79b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:21.819396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-faaf66ba-4b5c-4ff4-8710-83605f5e79b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:21.908368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf66ba-4b5c-4ff4-8710-83605f5e79b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:21.909941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf66ba-4b5c-4ff4-8710-83605f5e79b9 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:21.927761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 542/1096] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:23.054642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda712a-50bd-4220-bf09-729ce4e1b7a1 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:23.055246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda712a-50bd-4220-bf09-729ce4e1b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:23.055246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda712a-50bd-4220-bf09-729ce4e1b7a1 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:23.056762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 555/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:23.061556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e98ec-67d1-4865-b1d4-1a0762d36323 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:23.062002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e98ec-67d1-4865-b1d4-1a0762d36323 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:23.062122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e98ec-67d1-4865-b1d4-1a0762d36323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:23.116335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:23.137924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ad2e98ec-67d1-4865-b1d4-1a0762d36323 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:23.139165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ad2e98ec-67d1-4865-b1d4-1a0762d36323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:23.235117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 543/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 19:59:23.389754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda712a-50bd-4220-bf09-729ce4e1b7a1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:23.391335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-feda712a-50bd-4220-bf09-729ce4e1b7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:23.535905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda712a-50bd-4220-bf09-729ce4e1b7a1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:23.547686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:23.651544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f5cb-7e26-4220-b932-3b28043eb634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:23.652064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f5cb-7e26-4220-b932-3b28043eb634 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:23.652337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f5cb-7e26-4220-b932-3b28043eb634 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:23.652602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f5cb-7e26-4220-b932-3b28043eb634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:23.654189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e937f5cb-7e26-4220-b932-3b28043eb634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:23.740938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f5cb-7e26-4220-b932-3b28043eb634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:23.743147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f5cb-7e26-4220-b932-3b28043eb634 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:23.761759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 556/1099] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:24.893953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce067936-c437-456a-9883-be3e7dc632e5 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:24.894542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce067936-c437-456a-9883-be3e7dc632e5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:24.894542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce067936-c437-456a-9883-be3e7dc632e5 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:24.896178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 544/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:24.901266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470855-b6db-4e91-8151-109afec31015 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:24.901706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470855-b6db-4e91-8151-109afec31015 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:24.901817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470855-b6db-4e91-8151-109afec31015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:24.921492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:24.978483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-76470855-b6db-4e91-8151-109afec31015 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:24.988990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-76470855-b6db-4e91-8151-109afec31015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:25.082531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 557/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:25.232564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce067936-c437-456a-9883-be3e7dc632e5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:25.234032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ce067936-c437-456a-9883-be3e7dc632e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:25.344592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:25.379840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce067936-c437-456a-9883-be3e7dc632e5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:25.490527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaca50-430b-40d8-a8d2-0d4d2ac1830f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:25.491050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaca50-430b-40d8-a8d2-0d4d2ac1830f service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:25.491330 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaca50-430b-40d8-a8d2-0d4d2ac1830f service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:25.491605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaca50-430b-40d8-a8d2-0d4d2ac1830f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:25.493866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1faaca50-430b-40d8-a8d2-0d4d2ac1830f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:25.569983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:25.583632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaca50-430b-40d8-a8d2-0d4d2ac1830f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:25.585201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaca50-430b-40d8-a8d2-0d4d2ac1830f service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:25.603465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 545/1102] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:26.708957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816757-7b42-4af6-8d76-60e57a840b3f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:26.709487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816757-7b42-4af6-8d76-60e57a840b3f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:26.709487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57816757-7b42-4af6-8d76-60e57a840b3f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:26.710808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 558/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:26.716407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094e224-0994-42f1-bfe4-a8a5209370a2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:26.716867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094e224-0994-42f1-bfe4-a8a5209370a2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:26.716993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094e224-0994-42f1-bfe4-a8a5209370a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:26.794199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a094e224-0994-42f1-bfe4-a8a5209370a2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:26.795406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a094e224-0994-42f1-bfe4-a8a5209370a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:26.889835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 546/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:27.042984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57816757-7b42-4af6-8d76-60e57a840b3f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:27.044429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-57816757-7b42-4af6-8d76-60e57a840b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:27.128708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:27.194547 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57816757-7b42-4af6-8d76-60e57a840b3f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:27.312214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482861f7-4943-4624-a74e-32ff90270811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:27.312743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482861f7-4943-4624-a74e-32ff90270811 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:27.313024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482861f7-4943-4624-a74e-32ff90270811 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:27.313296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482861f7-4943-4624-a74e-32ff90270811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:27.314930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-482861f7-4943-4624-a74e-32ff90270811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:27.362595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:27.403883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482861f7-4943-4624-a74e-32ff90270811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:27.405459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482861f7-4943-4624-a74e-32ff90270811 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:27.424087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 559/1105] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:28.473451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b166d2-f3cb-48e0-91b7-4f5d34727950 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:28.474019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b166d2-f3cb-48e0-91b7-4f5d34727950 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:28.474019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b166d2-f3cb-48e0-91b7-4f5d34727950 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:28.475366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 547/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:28.481003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6799f2-ddb9-45dd-96e1-9516afc56500 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:28.481440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6799f2-ddb9-45dd-96e1-9516afc56500 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:28.481544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6799f2-ddb9-45dd-96e1-9516afc56500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:28.559055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5d6799f2-ddb9-45dd-96e1-9516afc56500 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:28.560264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5d6799f2-ddb9-45dd-96e1-9516afc56500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:28.659839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 560/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:28.813372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b166d2-f3cb-48e0-91b7-4f5d34727950 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:28.814847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f7b166d2-f3cb-48e0-91b7-4f5d34727950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:28.864017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:28.960920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b166d2-f3cb-48e0-91b7-4f5d34727950 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:29.073232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9895b5e-e2f8-4cff-8ca0-c67a59a4ad86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:29.073748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9895b5e-e2f8-4cff-8ca0-c67a59a4ad86 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:29.074027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9895b5e-e2f8-4cff-8ca0-c67a59a4ad86 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:29.074328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9895b5e-e2f8-4cff-8ca0-c67a59a4ad86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:29.075960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c9895b5e-e2f8-4cff-8ca0-c67a59a4ad86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:29.082809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:29.167082 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9895b5e-e2f8-4cff-8ca0-c67a59a4ad86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:29.168663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9895b5e-e2f8-4cff-8ca0-c67a59a4ad86 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:29.186057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 548/1108] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:30.245170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123a8e0-86bf-4a36-bf2c-880619c9d1fd None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:30.245686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123a8e0-86bf-4a36-bf2c-880619c9d1fd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:30.245686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123a8e0-86bf-4a36-bf2c-880619c9d1fd None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:30.247086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 561/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:30.251870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b585c9-0fce-4347-82cb-46cf5a25d879 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:30.252290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b585c9-0fce-4347-82cb-46cf5a25d879 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:30.252418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b585c9-0fce-4347-82cb-46cf5a25d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:30.328192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b3b585c9-0fce-4347-82cb-46cf5a25d879 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:30.329404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b3b585c9-0fce-4347-82cb-46cf5a25d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:30.396673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:30.426973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 549/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:30.576813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123a8e0-86bf-4a36-bf2c-880619c9d1fd None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:30.578286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a123a8e0-86bf-4a36-bf2c-880619c9d1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:30.596117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:30.728249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123a8e0-86bf-4a36-bf2c-880619c9d1fd None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:30.815836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:30.843115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5c9c-90ce-4de2-a7d2-dd4c6964930e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:30.843722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5c9c-90ce-4de2-a7d2-dd4c6964930e service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:30.843998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5c9c-90ce-4de2-a7d2-dd4c6964930e service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:30.844299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5c9c-90ce-4de2-a7d2-dd4c6964930e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:30.845887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-741c5c9c-90ce-4de2-a7d2-dd4c6964930e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:30.933466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5c9c-90ce-4de2-a7d2-dd4c6964930e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:30.935067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5c9c-90ce-4de2-a7d2-dd4c6964930e service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:30.953540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 562/1111] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:31.999709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891171-cd54-40ee-8624-7550908290f0 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:32.000295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891171-cd54-40ee-8624-7550908290f0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:32.000295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f891171-cd54-40ee-8624-7550908290f0 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:32.001587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 550/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:32.006415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2248c-6259-468a-a680-32f139b68977 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:32.006850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2248c-6259-468a-a680-32f139b68977 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:32.006983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2248c-6259-468a-a680-32f139b68977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:32.082503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-72d2248c-6259-468a-a680-32f139b68977 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:32.083720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-72d2248c-6259-468a-a680-32f139b68977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:32.124528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:32.178860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 563/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:32.329430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f891171-cd54-40ee-8624-7550908290f0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:32.331008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6f891171-cd54-40ee-8624-7550908290f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:32.480011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f891171-cd54-40ee-8624-7550908290f0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:32.534370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:32.592848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85950f4-cfd9-4adb-9993-3f62d1715a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:32.593382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85950f4-cfd9-4adb-9993-3f62d1715a56 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:32.593661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85950f4-cfd9-4adb-9993-3f62d1715a56 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:32.593935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85950f4-cfd9-4adb-9993-3f62d1715a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:32.595544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e85950f4-cfd9-4adb-9993-3f62d1715a56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:32.686795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85950f4-cfd9-4adb-9993-3f62d1715a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:32.688371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85950f4-cfd9-4adb-9993-3f62d1715a56 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:32.706855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 551/1114] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:33.753289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668ded-919b-4461-b76b-9a7c225e9512 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:33.753855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668ded-919b-4461-b76b-9a7c225e9512 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:33.753855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668ded-919b-4461-b76b-9a7c225e9512 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:33.755244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 564/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 19:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:33.761296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318389-2281-437e-86e7-31e46cc0eeef None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:33.761726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318389-2281-437e-86e7-31e46cc0eeef None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:33.761847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318389-2281-437e-86e7-31e46cc0eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:33.837007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-98318389-2281-437e-86e7-31e46cc0eeef None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:33.838257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-98318389-2281-437e-86e7-31e46cc0eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:33.840271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:33.933408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 552/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:34.083165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668ded-919b-4461-b76b-9a7c225e9512 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:34.084703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-73668ded-919b-4461-b76b-9a7c225e9512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:34.228969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668ded-919b-4461-b76b-9a7c225e9512 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:34.256803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:34.342969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21856702-26aa-4b01-a366-076f788acbaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:34.343563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856702-26aa-4b01-a366-076f788acbaf service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:34.344096 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856702-26aa-4b01-a366-076f788acbaf service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:34.344365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856702-26aa-4b01-a366-076f788acbaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:34.345934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-21856702-26aa-4b01-a366-076f788acbaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:34.435855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21856702-26aa-4b01-a366-076f788acbaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:34.437433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21856702-26aa-4b01-a366-076f788acbaf service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:34.456074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 565/1117] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:36.537735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1d71e-ed34-4a41-9fbd-3c9c85ee9c96 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:36.538310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1d71e-ed34-4a41-9fbd-3c9c85ee9c96 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:36.538310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1d71e-ed34-4a41-9fbd-3c9c85ee9c96 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:36.540243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 553/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:36.545542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659f617-723c-42c0-8440-a8300b852d97 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:36.545943 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659f617-723c-42c0-8440-a8300b852d97 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:36.546120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659f617-723c-42c0-8440-a8300b852d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:36.587283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:36.612767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c659f617-723c-42c0-8440-a8300b852d97 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:36.613953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c659f617-723c-42c0-8440-a8300b852d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:36.710615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 566/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:36.999256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1d71e-ed34-4a41-9fbd-3c9c85ee9c96 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:37.000811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-67b1d71e-ed34-4a41-9fbd-3c9c85ee9c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:37.102883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1d71e-ed34-4a41-9fbd-3c9c85ee9c96 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:37.134675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:37.174750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059144-9abf-43e9-b84e-97096e57fe47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:37.175350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059144-9abf-43e9-b84e-97096e57fe47 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:37.175635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059144-9abf-43e9-b84e-97096e57fe47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:37.175904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059144-9abf-43e9-b84e-97096e57fe47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:37.177490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4d059144-9abf-43e9-b84e-97096e57fe47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:37.289049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059144-9abf-43e9-b84e-97096e57fe47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:37.291403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059144-9abf-43e9-b84e-97096e57fe47 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:37.310454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 554/1120] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:39.709163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51268c21-ca7f-43be-b794-3df852808799 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:39.709722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51268c21-ca7f-43be-b794-3df852808799 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:39.709722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51268c21-ca7f-43be-b794-3df852808799 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:39.711370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 567/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:39.716523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b6b0-432f-489f-9e3c-109dae1a10e2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:39.716933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b6b0-432f-489f-9e3c-109dae1a10e2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:39.717060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b6b0-432f-489f-9e3c-109dae1a10e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:39.782702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f828b6b0-432f-489f-9e3c-109dae1a10e2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:39.783891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f828b6b0-432f-489f-9e3c-109dae1a10e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:39.797126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:39.883073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 555/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:40.205678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51268c21-ca7f-43be-b794-3df852808799 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:40.207326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-51268c21-ca7f-43be-b794-3df852808799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:40.331078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51268c21-ca7f-43be-b794-3df852808799 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:40.346340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:40.422247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828a395-5f5f-4652-9c85-811ecee42e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:40.422848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a395-5f5f-4652-9c85-811ecee42e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:40.423123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a395-5f5f-4652-9c85-811ecee42e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:40.423417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828a395-5f5f-4652-9c85-811ecee42e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:40.425003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e828a395-5f5f-4652-9c85-811ecee42e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:40.556247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828a395-5f5f-4652-9c85-811ecee42e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:40.557705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828a395-5f5f-4652-9c85-811ecee42e3f service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:40.578991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 568/1123] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:43.096909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612059c-e4a6-44ac-be74-7f591a914c36 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:43.097495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612059c-e4a6-44ac-be74-7f591a914c36 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:43.097495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612059c-e4a6-44ac-be74-7f591a914c36 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:43.098842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 556/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:43.104720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c624b1-3ba1-493d-add9-3c16d0a62804 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:43.105165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c624b1-3ba1-493d-add9-3c16d0a62804 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:43.105294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c624b1-3ba1-493d-add9-3c16d0a62804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:43.154014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:43.172300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-28c624b1-3ba1-493d-add9-3c16d0a62804 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:43.173495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-28c624b1-3ba1-493d-add9-3c16d0a62804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:43.268859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 569/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:43.552958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612059c-e4a6-44ac-be74-7f591a914c36 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:43.555102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5612059c-e4a6-44ac-be74-7f591a914c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:43.660680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612059c-e4a6-44ac-be74-7f591a914c36 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:43.701828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:43.736081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36d023-a8e7-4013-bceb-329d0ec1f2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:43.736676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36d023-a8e7-4013-bceb-329d0ec1f2fe service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:43.736954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36d023-a8e7-4013-bceb-329d0ec1f2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:43.737231 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36d023-a8e7-4013-bceb-329d0ec1f2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:43.738840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3d36d023-a8e7-4013-bceb-329d0ec1f2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:43.853921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36d023-a8e7-4013-bceb-329d0ec1f2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:43.855385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36d023-a8e7-4013-bceb-329d0ec1f2fe service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:43.873329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 557/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:46.171013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5299510-ec12-4c1e-becd-84155249779f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:46.171551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5299510-ec12-4c1e-becd-84155249779f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:46.171668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5299510-ec12-4c1e-becd-84155249779f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:46.172957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 570/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:46.178359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d9b4-7ca4-4edd-b365-a96c500f4fc3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:46.179325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d9b4-7ca4-4edd-b365-a96c500f4fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:46.179502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d9b4-7ca4-4edd-b365-a96c500f4fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:46.245325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e114d9b4-7ca4-4edd-b365-a96c500f4fc3 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:46.246543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e114d9b4-7ca4-4edd-b365-a96c500f4fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:46.267035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:46.342968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 558/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:46.632109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5299510-ec12-4c1e-becd-84155249779f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:46.633672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e5299510-ec12-4c1e-becd-84155249779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:46.736750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5299510-ec12-4c1e-becd-84155249779f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:46.758433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:46.815030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0e1bd-1fe5-48a8-b421-cd320d88b3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:46.815638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e1bd-1fe5-48a8-b421-cd320d88b3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:46.815914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e1bd-1fe5-48a8-b421-cd320d88b3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:46.816183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e1bd-1fe5-48a8-b421-cd320d88b3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:46.818051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-28a0e1bd-1fe5-48a8-b421-cd320d88b3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:46.927201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0e1bd-1fe5-48a8-b421-cd320d88b3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:46.928589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0e1bd-1fe5-48a8-b421-cd320d88b3f8 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:46.947041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 571/1129] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:49.158938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38718a43-468d-493b-a42f-a46beb6fb57f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:49.159498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38718a43-468d-493b-a42f-a46beb6fb57f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:49.159498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38718a43-468d-493b-a42f-a46beb6fb57f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:49.160844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 559/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:49.166377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701f30d-47f3-493a-962f-40a81af149cc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:49.166835 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701f30d-47f3-493a-962f-40a81af149cc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:49.166932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701f30d-47f3-493a-962f-40a81af149cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:49.230456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:49.233287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a701f30d-47f3-493a-962f-40a81af149cc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:49.235107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a701f30d-47f3-493a-962f-40a81af149cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:49.332261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 572/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:49.620144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38718a43-468d-493b-a42f-a46beb6fb57f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:49.621675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-38718a43-468d-493b-a42f-a46beb6fb57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:49.723549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38718a43-468d-493b-a42f-a46beb6fb57f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:49.772879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:49.797145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4ae4f-533c-4a4b-8767-ef59a8356ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:49.797739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ae4f-533c-4a4b-8767-ef59a8356ffa service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:49.798020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ae4f-533c-4a4b-8767-ef59a8356ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:49.798318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4ae4f-533c-4a4b-8767-ef59a8356ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:49.799900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-77a4ae4f-533c-4a4b-8767-ef59a8356ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:49.908411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4ae4f-533c-4a4b-8767-ef59a8356ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:49.909755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4ae4f-533c-4a4b-8767-ef59a8356ffa service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:49.928265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 560/1132] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:52.171948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e022f22-95a2-4e5c-aa58-efe36ee58398 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:52.172551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e022f22-95a2-4e5c-aa58-efe36ee58398 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:52.172551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e022f22-95a2-4e5c-aa58-efe36ee58398 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:52.173818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 573/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:52.179616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677de439-1fe3-4fec-afa0-98613fd31591 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:52.180063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677de439-1fe3-4fec-afa0-98613fd31591 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:52.180172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677de439-1fe3-4fec-afa0-98613fd31591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:52.245629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-677de439-1fe3-4fec-afa0-98613fd31591 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:52.246871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-677de439-1fe3-4fec-afa0-98613fd31591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:52.275606 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:52.343507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 561/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:52.635785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e022f22-95a2-4e5c-aa58-efe36ee58398 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:52.637341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9e022f22-95a2-4e5c-aa58-efe36ee58398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:52.739610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e022f22-95a2-4e5c-aa58-efe36ee58398 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:52.767884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:52.817887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826e701-83df-4090-bc8a-cea78c36f4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:52.818521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826e701-83df-4090-bc8a-cea78c36f4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:52.819275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826e701-83df-4090-bc8a-cea78c36f4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:52.819958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826e701-83df-4090-bc8a-cea78c36f4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:52.821586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4826e701-83df-4090-bc8a-cea78c36f4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:52.932516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826e701-83df-4090-bc8a-cea78c36f4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:52.933882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826e701-83df-4090-bc8a-cea78c36f4b2 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:52.953081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 574/1135] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:55.171685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ed59-3808-44df-97c9-094ac904cfde None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:55.172248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ed59-3808-44df-97c9-094ac904cfde None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:55.172248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ed59-3808-44df-97c9-094ac904cfde None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:55.173590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 562/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:55.179251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071809-6a5e-4e09-a6c4-f45a7454ca64 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:55.179677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071809-6a5e-4e09-a6c4-f45a7454ca64 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:55.179819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071809-6a5e-4e09-a6c4-f45a7454ca64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:55.244203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1a071809-6a5e-4e09-a6c4-f45a7454ca64 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:55.245393 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1a071809-6a5e-4e09-a6c4-f45a7454ca64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:55.253435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:55.343164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 575/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:55.630482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67ed59-3808-44df-97c9-094ac904cfde None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:55.632556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-de67ed59-3808-44df-97c9-094ac904cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:55.736732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67ed59-3808-44df-97c9-094ac904cfde None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:55.792156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:55.810832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677e1c1-411e-4d91-afab-468e1413cf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:55.811438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e1c1-411e-4d91-afab-468e1413cf4e service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:55.811718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e1c1-411e-4d91-afab-468e1413cf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:55.811992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e1c1-411e-4d91-afab-468e1413cf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:55.813583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0677e1c1-411e-4d91-afab-468e1413cf4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:55.929235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677e1c1-411e-4d91-afab-468e1413cf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:55.930989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677e1c1-411e-4d91-afab-468e1413cf4e service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:55.949128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 563/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 19:59:58.153061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f3cf-03ee-4d4b-8c67-38e45751d8e4 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:58.153737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f3cf-03ee-4d4b-8c67-38e45751d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:58.153737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275f3cf-03ee-4d4b-8c67-38e45751d8e4 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:58.155016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 576/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 19:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 19:59:58.160265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4576c-e775-4490-81cd-f68fd5691626 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:58.160706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4576c-e775-4490-81cd-f68fd5691626 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:58.160815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4576c-e775-4490-81cd-f68fd5691626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:58.227370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c4e4576c-e775-4490-81cd-f68fd5691626 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 19:59:58.228613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c4e4576c-e775-4490-81cd-f68fd5691626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:58.265910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:58.326859 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 564/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 19:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 19:59:58.608917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f3cf-03ee-4d4b-8c67-38e45751d8e4 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 19:59:58.610537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4275f3cf-03ee-4d4b-8c67-38e45751d8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:58.713452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275f3cf-03ee-4d4b-8c67-38e45751d8e4 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 19:59:58.750562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 19:59:58.786039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b8b3d-d7e4-467b-9ff8-ab993d155939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 19:59:58.786662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b8b3d-d7e4-467b-9ff8-ab993d155939 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 19:59:58.786937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b8b3d-d7e4-467b-9ff8-ab993d155939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 19:59:58.787704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b8b3d-d7e4-467b-9ff8-ab993d155939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 19:59:58.789267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b74b8b3d-d7e4-467b-9ff8-ab993d155939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 19:59:58.906712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b8b3d-d7e4-467b-9ff8-ab993d155939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 19:59:58.908161 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b8b3d-d7e4-467b-9ff8-ab993d155939 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 19:59:58.926239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 577/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 19:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:01.111552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e8fc-e5dd-47c2-b58b-03d15eab6b2e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:01.112143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e8fc-e5dd-47c2-b58b-03d15eab6b2e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:01.112143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0e8fc-e5dd-47c2-b58b-03d15eab6b2e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:01.113463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 565/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 20:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:01.118779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dcfe9-9502-483d-8ecf-1f8a32715654 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:01.119166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dcfe9-9502-483d-8ecf-1f8a32715654 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:01.119330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dcfe9-9502-483d-8ecf-1f8a32715654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:01.186301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-968dcfe9-9502-483d-8ecf-1f8a32715654 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:01.187513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-968dcfe9-9502-483d-8ecf-1f8a32715654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:01.205923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:01.283974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 578/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:01.568151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e8fc-e5dd-47c2-b58b-03d15eab6b2e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:01.570219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-99d0e8fc-e5dd-47c2-b58b-03d15eab6b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:01.674644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0e8fc-e5dd-47c2-b58b-03d15eab6b2e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:01.740879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:01.748614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d55cc-5f56-4bd6-816b-3eaa9dbcd554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:01.749213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d55cc-5f56-4bd6-816b-3eaa9dbcd554 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:01.749491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d55cc-5f56-4bd6-816b-3eaa9dbcd554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:01.749763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d55cc-5f56-4bd6-816b-3eaa9dbcd554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:01.751427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f53d55cc-5f56-4bd6-816b-3eaa9dbcd554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:01.860176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d55cc-5f56-4bd6-816b-3eaa9dbcd554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:01.861600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d55cc-5f56-4bd6-816b-3eaa9dbcd554 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:01.881437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 566/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:04.054556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9a851-3645-4cf5-ace2-dbb5c85df854 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:04.055095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9a851-3645-4cf5-ace2-dbb5c85df854 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:04.055095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9a851-3645-4cf5-ace2-dbb5c85df854 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:04.056342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 579/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 20:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:04.061907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9853ae5-9dfc-47fd-9d0c-2445ed687aeb None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:04.062505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9853ae5-9dfc-47fd-9d0c-2445ed687aeb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:04.062505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9853ae5-9dfc-47fd-9d0c-2445ed687aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:04.127680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f9853ae5-9dfc-47fd-9d0c-2445ed687aeb None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:04.128877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9853ae5-9dfc-47fd-9d0c-2445ed687aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:04.176072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:04.225355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 567/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:00:04.514979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9a851-3645-4cf5-ace2-dbb5c85df854 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:04.516515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f0d9a851-3645-4cf5-ace2-dbb5c85df854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:04.621255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9a851-3645-4cf5-ace2-dbb5c85df854 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:04.669410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:04.696179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93022d-698b-46b1-acb1-32f43ad18951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:04.696711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93022d-698b-46b1-acb1-32f43ad18951 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:04.696990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93022d-698b-46b1-acb1-32f43ad18951 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:04.697263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93022d-698b-46b1-acb1-32f43ad18951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:04.698888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9d93022d-698b-46b1-acb1-32f43ad18951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:04.807155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93022d-698b-46b1-acb1-32f43ad18951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:04.808580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93022d-698b-46b1-acb1-32f43ad18951 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:04.826481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 580/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:14.223945 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=22 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:14.824252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=66 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:24.757309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7a0c-75d9-434b-86b0-ab05de4423a6 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:24.757815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7a0c-75d9-434b-86b0-ab05de4423a6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:24.757815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7a0c-75d9-434b-86b0-ab05de4423a6 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:24.759191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 568/1148] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 20:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:24.764323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23083-98f9-4f6c-a10d-c38acc33baea None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:24.764765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23083-98f9-4f6c-a10d-c38acc33baea None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:24.764944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b23083-98f9-4f6c-a10d-c38acc33baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:24.832893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-68b23083-98f9-4f6c-a10d-c38acc33baea None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:24.834117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-68b23083-98f9-4f6c-a10d-c38acc33baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:24.930239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 581/1149] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 20:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:25.244897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118efef-8cd9-45a1-b241-53edddf7b98c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:25.245211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118efef-8cd9-45a1-b241-53edddf7b98c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:25.245492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118efef-8cd9-45a1-b241-53edddf7b98c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:25.246924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 569/1150] 10.222.0.18 () {54 vars in 962 bytes} [Sun Oct 23 20:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:25.251716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3ee2-4d57-40d1-8319-f41cacda92fe None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:25.251997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3ee2-4d57-40d1-8319-f41cacda92fe None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:25.252267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3ee2-4d57-40d1-8319-f41cacda92fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:25.327942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-adaf3ee2-4d57-40d1-8319-f41cacda92fe None None] MFA Rules not processed for user `d8c8ca8a1b1a4cffaf64bc0840b5fd02`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:25.329147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-adaf3ee2-4d57-40d1-8319-f41cacda92fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:25.350823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:25.405058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 582/1151] 10.222.0.18 () {58 vars in 1059 bytes} [Sun Oct 23 20:00:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:25.413617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118efef-8cd9-45a1-b241-53edddf7b98c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:25.415169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9118efef-8cd9-45a1-b241-53edddf7b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:25.517396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118efef-8cd9-45a1-b241-53edddf7b98c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:25.590827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5269c1-238a-47de-b410-dbbc004667fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:25.591424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5269c1-238a-47de-b410-dbbc004667fd service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:25.591706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5269c1-238a-47de-b410-dbbc004667fd service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:25.591983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5269c1-238a-47de-b410-dbbc004667fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:25.593568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ec5269c1-238a-47de-b410-dbbc004667fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:25.648141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:25.703309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5269c1-238a-47de-b410-dbbc004667fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:25.704744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5269c1-238a-47de-b410-dbbc004667fd service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:25.724649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 570/1152] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:27.973087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14a34-c11c-433f-b5f4-238a9a54270a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:27.973597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14a34-c11c-433f-b5f4-238a9a54270a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:27.973729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14a34-c11c-433f-b5f4-238a9a54270a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:27.975099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 583/1153] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 20:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:27.980582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456adb72-6089-4bfa-a273-229602795b32 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:27.981005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456adb72-6089-4bfa-a273-229602795b32 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:27.981133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456adb72-6089-4bfa-a273-229602795b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:28.045883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-456adb72-6089-4bfa-a273-229602795b32 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:28.047123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-456adb72-6089-4bfa-a273-229602795b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:28.141972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 571/1154] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 20:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:28.423897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14a34-c11c-433f-b5f4-238a9a54270a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:28.425416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fef14a34-c11c-433f-b5f4-238a9a54270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:28.553030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14a34-c11c-433f-b5f4-238a9a54270a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:28.607524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:28.653530 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a4fe5-c0e3-440d-a592-f705dddd7e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:28.654171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4fe5-c0e3-440d-a592-f705dddd7e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:28.654450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4fe5-c0e3-440d-a592-f705dddd7e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:28.654721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a4fe5-c0e3-440d-a592-f705dddd7e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:28.655350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a4fe5-c0e3-440d-a592-f705dddd7e24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:28.656355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-052a4fe5-c0e3-440d-a592-f705dddd7e24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:00:28.656355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 20:00:28.656355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 20:00:28.657485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a4fe5-c0e3-440d-a592-f705dddd7e24 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:28.677016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 584/1155] 10.222.0.18 () {56 vars in 1108 bytes} [Sun Oct 23 20:00:28 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:00:30.850817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b753d4-961b-4dfe-be9d-6ed4818a1ceb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:30.851424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b753d4-961b-4dfe-be9d-6ed4818a1ceb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:30.851424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b753d4-961b-4dfe-be9d-6ed4818a1ceb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:30.852795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 572/1156] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 20:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:30.858024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadad8f-7b84-440e-946f-a1f535d14f56 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:30.858463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadad8f-7b84-440e-946f-a1f535d14f56 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:30.858603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadad8f-7b84-440e-946f-a1f535d14f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:30.923667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bbadad8f-7b84-440e-946f-a1f535d14f56 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:30.924906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bbadad8f-7b84-440e-946f-a1f535d14f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:31.022707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 585/1157] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:31.323799 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b753d4-961b-4dfe-be9d-6ed4818a1ceb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:31.325431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b5b753d4-961b-4dfe-be9d-6ed4818a1ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:31.335667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:31.470837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b753d4-961b-4dfe-be9d-6ed4818a1ceb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:31.550257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:31.583208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6690-1c54-4126-81dd-de8d59284be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:31.583808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6690-1c54-4126-81dd-de8d59284be2 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:31.584092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6690-1c54-4126-81dd-de8d59284be2 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:31.584367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6690-1c54-4126-81dd-de8d59284be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:31.585950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-39ed6690-1c54-4126-81dd-de8d59284be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:31.676739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed6690-1c54-4126-81dd-de8d59284be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:31.678252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed6690-1c54-4126-81dd-de8d59284be2 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:31.696209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 573/1158] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:34.026151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609e45-6cce-457c-a60f-63d8b29b0d49 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:34.026677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609e45-6cce-457c-a60f-63d8b29b0d49 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:34.026677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53609e45-6cce-457c-a60f-63d8b29b0d49 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:34.027953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 586/1159] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 20:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:34.033143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8dfeb-ec1f-4c10-a663-b389aa73bbaf None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:34.033553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8dfeb-ec1f-4c10-a663-b389aa73bbaf None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:34.033725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8dfeb-ec1f-4c10-a663-b389aa73bbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:34.098921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d7f8dfeb-ec1f-4c10-a663-b389aa73bbaf None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:34.100128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d7f8dfeb-ec1f-4c10-a663-b389aa73bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:34.146163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:34.196967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 574/1160] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 20:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:00:34.490230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609e45-6cce-457c-a60f-63d8b29b0d49 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:34.491768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-53609e45-6cce-457c-a60f-63d8b29b0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:34.515789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:34.594260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53609e45-6cce-457c-a60f-63d8b29b0d49 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:34.668727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fee9a-8d31-413e-9b6f-b3e57391e2c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:34.669332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fee9a-8d31-413e-9b6f-b3e57391e2c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:34.669610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fee9a-8d31-413e-9b6f-b3e57391e2c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:34.669880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fee9a-8d31-413e-9b6f-b3e57391e2c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:34.671489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f21fee9a-8d31-413e-9b6f-b3e57391e2c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:34.747227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:34.781347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fee9a-8d31-413e-9b6f-b3e57391e2c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:34.782825 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fee9a-8d31-413e-9b6f-b3e57391e2c4 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:34.801609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 587/1161] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:37.039552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d70a3-cbc4-4bcd-bf73-f11ede2b0252 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:37.040123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d70a3-cbc4-4bcd-bf73-f11ede2b0252 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:37.040123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d70a3-cbc4-4bcd-bf73-f11ede2b0252 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:37.041472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 575/1162] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 20:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:37.046935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57de41-b8d7-4e67-911c-56076a4fcc63 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:37.047338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57de41-b8d7-4e67-911c-56076a4fcc63 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:37.047541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57de41-b8d7-4e67-911c-56076a4fcc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:37.113965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8c57de41-b8d7-4e67-911c-56076a4fcc63 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:37.115208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8c57de41-b8d7-4e67-911c-56076a4fcc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:37.211077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 588/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 20:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:37.499428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d70a3-cbc4-4bcd-bf73-f11ede2b0252 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:37.501004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7e3d70a3-cbc4-4bcd-bf73-f11ede2b0252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:37.604257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d70a3-cbc4-4bcd-bf73-f11ede2b0252 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:37.676748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:37.678278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfef76b-8260-435a-b683-e344855c53ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:37.678927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfef76b-8260-435a-b683-e344855c53ed service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:37.679203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfef76b-8260-435a-b683-e344855c53ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:37.679622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfef76b-8260-435a-b683-e344855c53ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:37.681805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5bfef76b-8260-435a-b683-e344855c53ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:37.788293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfef76b-8260-435a-b683-e344855c53ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:37.789641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfef76b-8260-435a-b683-e344855c53ed service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:37.808121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 576/1164] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:00:40.061455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db376-24be-4ba0-82e2-598d09f792cc None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:40.061960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db376-24be-4ba0-82e2-598d09f792cc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:40.062065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db376-24be-4ba0-82e2-598d09f792cc None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:40.063384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 589/1165] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 20:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:40.069379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13fb8d-346d-4eee-a423-aa3e69ec055a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:40.069787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13fb8d-346d-4eee-a423-aa3e69ec055a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:40.069929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13fb8d-346d-4eee-a423-aa3e69ec055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:40.137048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5e13fb8d-346d-4eee-a423-aa3e69ec055a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:40.138273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5e13fb8d-346d-4eee-a423-aa3e69ec055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:40.192730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:40.236276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 577/1166] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 20:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:40.528551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368db376-24be-4ba0-82e2-598d09f792cc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:40.530142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-368db376-24be-4ba0-82e2-598d09f792cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:40.566139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:40.633205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368db376-24be-4ba0-82e2-598d09f792cc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:40.705752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfedc55-0094-4489-adfc-c6123175c497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:40.706887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfedc55-0094-4489-adfc-c6123175c497 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:40.707273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfedc55-0094-4489-adfc-c6123175c497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:40.707546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfedc55-0094-4489-adfc-c6123175c497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:40.709123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ccfedc55-0094-4489-adfc-c6123175c497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:40.787463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:40.816894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfedc55-0094-4489-adfc-c6123175c497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:40.818341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfedc55-0094-4489-adfc-c6123175c497 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:40.836629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 590/1167] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:43.263581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6030f8-8c92-41e8-aa48-63a47d2ec18e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:43.264148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6030f8-8c92-41e8-aa48-63a47d2ec18e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:43.264148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6030f8-8c92-41e8-aa48-63a47d2ec18e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:43.265466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 578/1168] 10.222.0.18 () {54 vars in 927 bytes} [Sun Oct 23 20:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:00:43.270974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729d74-7117-422e-b539-22b3bca828f8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:43.271383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729d74-7117-422e-b539-22b3bca828f8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:43.271536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729d74-7117-422e-b539-22b3bca828f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:43.339823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b9729d74-7117-422e-b539-22b3bca828f8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:00:43.341052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b9729d74-7117-422e-b539-22b3bca828f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:43.435297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 591/1169] 10.222.0.18 () {58 vars in 1024 bytes} [Sun Oct 23 20:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:00:43.724004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6030f8-8c92-41e8-aa48-63a47d2ec18e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:00:43.725536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1f6030f8-8c92-41e8-aa48-63a47d2ec18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:43.826695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6030f8-8c92-41e8-aa48-63a47d2ec18e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:00:43.900164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97002e1f-ec1b-445b-a735-dfe7bca88aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:00:43.900686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002e1f-ec1b-445b-a735-dfe7bca88aed service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:00:43.900967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002e1f-ec1b-445b-a735-dfe7bca88aed service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:00:43.901242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002e1f-ec1b-445b-a735-dfe7bca88aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:00:43.902877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-97002e1f-ec1b-445b-a735-dfe7bca88aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:00:43.912409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:44.012047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97002e1f-ec1b-445b-a735-dfe7bca88aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:00:44.013469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97002e1f-ec1b-445b-a735-dfe7bca88aed service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:00:44.031629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 579/1170] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:00:53.433773 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=82 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:00:54.029338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=50 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:57.081036 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:57.081628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:57.081628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:57.156961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:01:57.158196 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:57.256650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 592/1171] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:01:57.264598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9acacb-a126-4188-bca6-101771845de2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:57.265082 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9acacb-a126-4188-bca6-101771845de2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:57.265184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9acacb-a126-4188-bca6-101771845de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:57.341883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9e9acacb-a126-4188-bca6-101771845de2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:01:57.343531 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9e9acacb-a126-4188-bca6-101771845de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:57.440497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 580/1172] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:01:57.445109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:57.446369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:57.458117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd880f1-a708-4c54-bcfd-e3905749faa3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:57.518984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:57.554037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:57.554673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:57.554947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:57.555219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:57.555860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:01:57.556163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:57.557169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:01:57.557169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 20:01:57.557169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 20:01:57.558052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:57.569859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 593/1173] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:01:57.579219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9acacb-a126-4188-bca6-101771845de2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:57.588289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9acacb-a126-4188-bca6-101771845de2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:57.650036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:57.683200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:57.683912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:57.684195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:57.684466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:57.685104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:57.686225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:01:57.686225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 20:01:57.686225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 20:01:57.688353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:57.743020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 581/1174] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:01:57 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:01:57.747397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:57.748961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:57.783065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e3eca-b9e9-4610-a93d-4cd26e9a6bca admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:57.875040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:57.875568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:57.875848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:57.876122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:57.876744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:57.877755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:01:57.877755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 20:01:57.877755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 20:01:57.878994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:57.922631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 594/1175] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:01:57 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:01:57.926693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:57.928455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:57.990252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50745af-5a41-4adc-a5c8-40288e5051a1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:58.072007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:58.083633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:58.084237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:58.084515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:58.084784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:58.085420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:58.087025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:58.099155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 582/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:01:58.103174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:58.104707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:58.116349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299f19-50f4-41f2-a7f9-290918d35d88 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:58.141712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:58.210643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701433ff-8954-4194-9c41-f724867fe182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:58.211240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701433ff-8954-4194-9c41-f724867fe182 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:58.211515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701433ff-8954-4194-9c41-f724867fe182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:58.211780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701433ff-8954-4194-9c41-f724867fe182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:58.212406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701433ff-8954-4194-9c41-f724867fe182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:58.213976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701433ff-8954-4194-9c41-f724867fe182 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:58.225820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 595/1177] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:01:58.230003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:58.231559 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:58.265737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea3c69-0c1f-44f1-97ad-98c4c9abe3a2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:58.362626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eee80-fb82-4d0b-a44b-5fe9d7219100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:58.363286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eee80-fb82-4d0b-a44b-5fe9d7219100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:58.363570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eee80-fb82-4d0b-a44b-5fe9d7219100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:58.363848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eee80-fb82-4d0b-a44b-5fe9d7219100 admin admin] PATH_INFO: `/v3/projects/d6a0140db1b64743baf145d9cba561d9/users/746a07e6765d41be9c0af544dec79183/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:58.386654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eee80-fb82-4d0b-a44b-5fe9d7219100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a0140db1b64743baf145d9cba561d9, user_id=746a07e6765d41be9c0af544dec79183, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:58.389320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eee80-fb82-4d0b-a44b-5fe9d7219100 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:58.414165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 583/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:01:58 2022] PUT /identity/v3/projects/d6a0140db1b64743baf145d9cba561d9/users/746a07e6765d41be9c0af544dec79183/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:01:58.425571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef180-71e8-4667-8e51-9640f699c164 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:58.425932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef180-71e8-4667-8e51-9640f699c164 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:58.426327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef180-71e8-4667-8e51-9640f699c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:58.482450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9e7ef180-71e8-4667-8e51-9640f699c164 None None] MFA Rules not processed for user `746a07e6765d41be9c0af544dec79183`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:01:58.484209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9e7ef180-71e8-4667-8e51-9640f699c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:58.564416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 596/1179] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:01:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:01:58.578311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c12e-c0c3-4fb6-8abb-bb468b1371b2 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:58.578706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c12e-c0c3-4fb6-8abb-bb468b1371b2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:58.579051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c12e-c0c3-4fb6-8abb-bb468b1371b2 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:58.580498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 584/1180] 10.222.0.18 () {54 vars in 963 bytes} [Sun Oct 23 20:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:01:58.586063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb42132-2fe6-471f-9158-6d96aeb942a8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:58.586373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb42132-2fe6-471f-9158-6d96aeb942a8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:58.586695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb42132-2fe6-471f-9158-6d96aeb942a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:58.620041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:58.665220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5cb42132-2fe6-471f-9158-6d96aeb942a8 None None] MFA Rules not processed for user `201521dc87e544c0afcee0f7a7d0af7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:01:58.666386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5cb42132-2fe6-471f-9158-6d96aeb942a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:58.739817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 597/1181] 10.222.0.18 () {58 vars in 1060 bytes} [Sun Oct 23 20:01:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:01:58.749536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c12e-c0c3-4fb6-8abb-bb468b1371b2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:58.751114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-80f0c12e-c0c3-4fb6-8abb-bb468b1371b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:58.801009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:58.854942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c12e-c0c3-4fb6-8abb-bb468b1371b2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:58.929609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:58.930158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:58.930434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:58.930703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:58.932281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:59.029483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:59.031601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:59.035008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:59.049824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 585/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:01:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:01:59.095733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b25a-2052-42a2-886c-1c1fe834e643 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:59.096022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b25a-2052-42a2-886c-1c1fe834e643 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:59.096298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b25a-2052-42a2-886c-1c1fe834e643 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:59.097552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 598/1183] 10.222.0.18 () {52 vars in 830 bytes} [Sun Oct 23 20:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:01:59.101033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:59.102335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:59.201787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22b80-627b-4d03-883d-c0ae9ed355ee service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:59.295269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:59.295967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:59.296250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:59.296551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] PATH_INFO: `/v3/users/746a07e6765d41be9c0af544dec79183` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:59.309313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746a07e6765d41be9c0af544dec79183)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:59.310366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:01:59.310366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 20:01:59.310366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 20:01:59.312160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:59.321834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:59.386419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746a07e6765d41be9c0af544dec79183'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:01:59.401001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746a07e6765d41be9c0af544dec79183'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:01:59.410474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746a07e6765d41be9c0af544dec79183'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:01:59.410964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746a07e6765d41be9c0af544dec79183'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:01:59.433495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746a07e6765d41be9c0af544dec79183'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:01:59.440594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 586/1184] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:01:59 2022] DELETE /identity/v3/users/746a07e6765d41be9c0af544dec79183 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:01:59.448375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:59.448846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:59.448964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:59.505442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:01:59.506583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:59.582001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:59.594384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 599/1185] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:01:59.605358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:01:59.606180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:59.704993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f19b19-6b2c-4c28-ae39-1d9503b682d0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:01:59.759533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:01:59.780296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243855e9-9ca1-4239-bb81-de186e82f578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:01:59.780862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243855e9-9ca1-4239-bb81-de186e82f578 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:01:59.781123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243855e9-9ca1-4239-bb81-de186e82f578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:01:59.781393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243855e9-9ca1-4239-bb81-de186e82f578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:01:59.782989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-243855e9-9ca1-4239-bb81-de186e82f578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:01:59.891577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243855e9-9ca1-4239-bb81-de186e82f578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:01:59.892995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243855e9-9ca1-4239-bb81-de186e82f578 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:01:59.910177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 587/1186] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:02:00.315670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:02:00.316892 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:02:00.329067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dd134-8212-45ef-b0a2-38270cfd2a31 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:02:00.427806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:02:00.428354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:02:00.428633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:02:00.428905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] PATH_INFO: `/v3/projects/d6a0140db1b64743baf145d9cba561d9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:02:00.439052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a0140db1b64743baf145d9cba561d9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:02:00.440083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:02:00.440083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 20:02:00.440083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 20:02:00.441279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:02:00.499468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a0140db1b64743baf145d9cba561d9', 'request_id': 'req-1d43eee6-3906-4bb9-a0ae-785e692f5488'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:02:00.512412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a0140db1b64743baf145d9cba561d9', 'request_id': 'req-1d43eee6-3906-4bb9-a0ae-785e692f5488'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:02:00.523068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a0140db1b64743baf145d9cba561d9', 'request_id': 'req-1d43eee6-3906-4bb9-a0ae-785e692f5488'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:02:00.548247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] The token cache is being invalidate because project d6a0140db1b64743baf145d9cba561d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:02:00.548533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:02:00.548956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1d43eee6-3906-4bb9-a0ae-785e692f5488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:02:00.550380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 600/1187] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:02:00 2022] DELETE /identity/v3/projects/d6a0140db1b64743baf145d9cba561d9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:02:09.908065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=62 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:02:10.546199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:03:32.303537 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f82be-c115-4553-aae2-60eb6ef23adc None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:32.304132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f82be-c115-4553-aae2-60eb6ef23adc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:32.304132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f82be-c115-4553-aae2-60eb6ef23adc None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:32.305447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 588/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 20:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:32.310262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a7be-8a53-42fa-a2a5-4bbc5217ed21 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:32.310693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a7be-8a53-42fa-a2a5-4bbc5217ed21 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:32.310822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019a7be-8a53-42fa-a2a5-4bbc5217ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:32.393983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d019a7be-8a53-42fa-a2a5-4bbc5217ed21 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:32.395230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d019a7be-8a53-42fa-a2a5-4bbc5217ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:32.500584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 601/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:32.655816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f82be-c115-4553-aae2-60eb6ef23adc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:32.657909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-773f82be-c115-4553-aae2-60eb6ef23adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:32.774819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f82be-c115-4553-aae2-60eb6ef23adc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:32.780219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2f075-ce1b-4cea-b739-5914e56be213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:32.780814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f075-ce1b-4cea-b739-5914e56be213 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:32.781092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f075-ce1b-4cea-b739-5914e56be213 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:32.781365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f075-ce1b-4cea-b739-5914e56be213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:32.789610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2f075-ce1b-4cea-b739-5914e56be213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:32.791210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2f075-ce1b-4cea-b739-5914e56be213 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:32.800688 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 589/1190] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:03:33.879980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0740-aed9-4c55-ad59-4a6b757a90ad None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:33.880514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0740-aed9-4c55-ad59-4a6b757a90ad None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:33.880514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0740-aed9-4c55-ad59-4a6b757a90ad None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:33.881786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 602/1191] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 20:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:33.886559 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4decfac-3cba-464d-8304-b2d05ffef5ae None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:33.886963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4decfac-3cba-464d-8304-b2d05ffef5ae None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:33.887112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4decfac-3cba-464d-8304-b2d05ffef5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:33.907490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b4decfac-3cba-464d-8304-b2d05ffef5ae None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:33.909678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b4decfac-3cba-464d-8304-b2d05ffef5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:33.917763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 590/1192] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:34.068462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0740-aed9-4c55-ad59-4a6b757a90ad None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:34.082568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0740-aed9-4c55-ad59-4a6b757a90ad None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:34.087926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1fcc5-8373-43c2-af20-1474463a1d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:34.088506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1fcc5-8373-43c2-af20-1474463a1d4d service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:34.088786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1fcc5-8373-43c2-af20-1474463a1d4d service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:34.089056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1fcc5-8373-43c2-af20-1474463a1d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:34.097527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1fcc5-8373-43c2-af20-1474463a1d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:34.099124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1fcc5-8373-43c2-af20-1474463a1d4d service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:34.101483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ac9f-c521-4f98-aeb3-500eb6720aac None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:34.101839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ac9f-c521-4f98-aeb3-500eb6720aac None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:34.102216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ac9f-c521-4f98-aeb3-500eb6720aac None None] PATH_INFO: `/v3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:34.103944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 591/1193] 10.222.0.25 () {54 vars in 925 bytes} [Sun Oct 23 20:03:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:03:34.108618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 603/1194] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:03:34.110396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304bc7-0bc8-4408-b62a-19954a16399f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:34.110689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304bc7-0bc8-4408-b62a-19954a16399f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:34.111661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304bc7-0bc8-4408-b62a-19954a16399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:34.176561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4f304bc7-0bc8-4408-b62a-19954a16399f None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:34.177863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4f304bc7-0bc8-4408-b62a-19954a16399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:34.234823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:03:34.255142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 592/1195] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Oct 23 20:03:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:37.816476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31469cf-9b45-40d0-8a6a-3a5b417d1e07 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:37.816968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31469cf-9b45-40d0-8a6a-3a5b417d1e07 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:37.817089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31469cf-9b45-40d0-8a6a-3a5b417d1e07 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:37.818398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 604/1196] 10.222.0.18 () {54 vars in 961 bytes} [Sun Oct 23 20:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:37.823787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c43de-3733-4886-9f4d-6682bf8ab0d6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:37.824232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c43de-3733-4886-9f4d-6682bf8ab0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:37.824343 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c43de-3733-4886-9f4d-6682bf8ab0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:37.844876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-361c43de-3733-4886-9f4d-6682bf8ab0d6 None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:37.846739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-361c43de-3733-4886-9f4d-6682bf8ab0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:37.855244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 593/1197] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Oct 23 20:03:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:37.863375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31469cf-9b45-40d0-8a6a-3a5b417d1e07 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:37.877493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31469cf-9b45-40d0-8a6a-3a5b417d1e07 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:37.882427 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b45a-711e-41f7-9d79-99a4f5333e0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:37.883645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b45a-711e-41f7-9d79-99a4f5333e0b service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:37.883926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b45a-711e-41f7-9d79-99a4f5333e0b service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:37.884208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b45a-711e-41f7-9d79-99a4f5333e0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:37.893159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844b45a-711e-41f7-9d79-99a4f5333e0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:37.894887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844b45a-711e-41f7-9d79-99a4f5333e0b service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:37.906492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 605/1198] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:03:45.631631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364894c-5536-43de-92b3-11e0ec354acd None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:45.632163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364894c-5536-43de-92b3-11e0ec354acd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:45.632163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364894c-5536-43de-92b3-11e0ec354acd None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:45.633526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 594/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 20:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:45.638421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434404e-823f-4d83-b3b9-9fde131631cc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:45.638811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434404e-823f-4d83-b3b9-9fde131631cc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:45.638957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434404e-823f-4d83-b3b9-9fde131631cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:45.659788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a434404e-823f-4d83-b3b9-9fde131631cc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:45.660973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a434404e-823f-4d83-b3b9-9fde131631cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:45.668725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 606/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:45.826069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364894c-5536-43de-92b3-11e0ec354acd None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:45.840480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364894c-5536-43de-92b3-11e0ec354acd None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:45.846059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18da25-0cdb-4fdd-81bc-73fdd5d05d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:45.846691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18da25-0cdb-4fdd-81bc-73fdd5d05d94 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:45.846975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18da25-0cdb-4fdd-81bc-73fdd5d05d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:45.847252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18da25-0cdb-4fdd-81bc-73fdd5d05d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:45.855297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18da25-0cdb-4fdd-81bc-73fdd5d05d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:45.856809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18da25-0cdb-4fdd-81bc-73fdd5d05d94 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:45.866670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 595/1201] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:03:46.924387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ced-9c75-41e0-9969-748c942786c5 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:46.924953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ced-9c75-41e0-9969-748c942786c5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:46.924953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114ced-9c75-41e0-9969-748c942786c5 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:46.926276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 607/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 20:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:46.931031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570920a-3691-4cf9-bb88-9adacb3057c5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:46.931463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570920a-3691-4cf9-bb88-9adacb3057c5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:46.931586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570920a-3691-4cf9-bb88-9adacb3057c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:46.951421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f570920a-3691-4cf9-bb88-9adacb3057c5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:46.952605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f570920a-3691-4cf9-bb88-9adacb3057c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:46.960979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 596/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:03:47.111312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114ced-9c75-41e0-9969-748c942786c5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:47.125432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114ced-9c75-41e0-9969-748c942786c5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:47.131575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb9131-7dc9-43da-93dd-2f2b295d9110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:47.132162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9131-7dc9-43da-93dd-2f2b295d9110 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:47.132443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9131-7dc9-43da-93dd-2f2b295d9110 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:47.132718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9131-7dc9-43da-93dd-2f2b295d9110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:47.140703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb9131-7dc9-43da-93dd-2f2b295d9110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:47.142945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb9131-7dc9-43da-93dd-2f2b295d9110 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:47.152173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 608/1204] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:03:50.990863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1c5c3-cf7f-4d8f-82eb-24aa31cb4214 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:50.991482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1c5c3-cf7f-4d8f-82eb-24aa31cb4214 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:50.991482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1c5c3-cf7f-4d8f-82eb-24aa31cb4214 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:50.992838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 597/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 20:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:50.998161 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298b62-fc36-4042-b00e-ea49cfadd641 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:50.998587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298b62-fc36-4042-b00e-ea49cfadd641 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:50.998723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61298b62-fc36-4042-b00e-ea49cfadd641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:51.018446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-61298b62-fc36-4042-b00e-ea49cfadd641 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:51.019644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-61298b62-fc36-4042-b00e-ea49cfadd641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:51.027606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 609/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:51.320822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1c5c3-cf7f-4d8f-82eb-24aa31cb4214 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:51.322553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0ab1c5c3-cf7f-4d8f-82eb-24aa31cb4214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:51.398548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1c5c3-cf7f-4d8f-82eb-24aa31cb4214 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:51.402067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719245e-e9a4-478a-905c-2ef8a21460fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:51.402699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719245e-e9a4-478a-905c-2ef8a21460fc service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:51.402983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719245e-e9a4-478a-905c-2ef8a21460fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:51.403258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719245e-e9a4-478a-905c-2ef8a21460fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:51.412642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719245e-e9a4-478a-905c-2ef8a21460fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:51.414052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719245e-e9a4-478a-905c-2ef8a21460fc service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:51.424008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 598/1207] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:03:53.572063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dcdbf-7313-4dde-a523-ea9d2f351e46 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:53.572663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dcdbf-7313-4dde-a523-ea9d2f351e46 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:53.572663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dcdbf-7313-4dde-a523-ea9d2f351e46 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:53.573934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 610/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 20:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:53.579073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8d82-1549-435a-b4dd-ca7fd38393d8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:53.579956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8d82-1549-435a-b4dd-ca7fd38393d8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:53.579956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8d82-1549-435a-b4dd-ca7fd38393d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:53.600060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f69b8d82-1549-435a-b4dd-ca7fd38393d8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:53.601274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f69b8d82-1549-435a-b4dd-ca7fd38393d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:53.610913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 599/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:53.897829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dcdbf-7313-4dde-a523-ea9d2f351e46 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:53.909434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dcdbf-7313-4dde-a523-ea9d2f351e46 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:53.912989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14e671-67da-47b5-a542-e504928a08cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:53.913574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14e671-67da-47b5-a542-e504928a08cd service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:53.913852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14e671-67da-47b5-a542-e504928a08cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:53.914160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14e671-67da-47b5-a542-e504928a08cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:53.923294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14e671-67da-47b5-a542-e504928a08cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:53.924716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14e671-67da-47b5-a542-e504928a08cd service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:53.934030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 611/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:03:57.635026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa88f8-7e07-475e-9926-52168061e790 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:57.635553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa88f8-7e07-475e-9926-52168061e790 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:57.635651 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa88f8-7e07-475e-9926-52168061e790 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:57.636927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 600/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 20:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:03:57.643042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f297d2d-0573-4f79-948f-0f5a3eaa27a8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:57.643489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f297d2d-0573-4f79-948f-0f5a3eaa27a8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:57.643601 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f297d2d-0573-4f79-948f-0f5a3eaa27a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:57.651083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:03:57.664880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7f297d2d-0573-4f79-948f-0f5a3eaa27a8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:03:57.666061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7f297d2d-0573-4f79-948f-0f5a3eaa27a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:57.674353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 612/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:03:57.980911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa88f8-7e07-475e-9926-52168061e790 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:03:57.982674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c6fa88f8-7e07-475e-9926-52168061e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:03:58.061838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa88f8-7e07-475e-9926-52168061e790 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:03:58.065701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd8043-63c7-49f8-9cd3-f3665de921ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:03:58.066331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd8043-63c7-49f8-9cd3-f3665de921ff service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:03:58.066617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd8043-63c7-49f8-9cd3-f3665de921ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:03:58.066888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd8043-63c7-49f8-9cd3-f3665de921ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:03:58.075743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd8043-63c7-49f8-9cd3-f3665de921ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:03:58.077153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd8043-63c7-49f8-9cd3-f3665de921ff service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:03:58.086350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 601/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:04:00.235993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c9a4e-760a-4748-9331-76af869a1203 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:04:00.236596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c9a4e-760a-4748-9331-76af869a1203 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:04:00.236596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c9a4e-760a-4748-9331-76af869a1203 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:04:00.237882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 613/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 20:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:04:00.243198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d76e-739e-4830-a8b7-aae09688b5bf None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:04:00.243599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d76e-739e-4830-a8b7-aae09688b5bf None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:04:00.243770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d76e-739e-4830-a8b7-aae09688b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:04:00.263444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0609d76e-739e-4830-a8b7-aae09688b5bf None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:04:00.264645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0609d76e-739e-4830-a8b7-aae09688b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:04:00.272655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 602/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:04:00.574906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c9a4e-760a-4748-9331-76af869a1203 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:04:00.576583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4f8c9a4e-760a-4748-9331-76af869a1203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:04:00.589746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c9a4e-760a-4748-9331-76af869a1203 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:04:00.593168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea96473-de69-4635-b6ab-f8dd40aa7db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:04:00.593749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96473-de69-4635-b6ab-f8dd40aa7db5 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:04:00.594027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96473-de69-4635-b6ab-f8dd40aa7db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:04:00.594907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96473-de69-4635-b6ab-f8dd40aa7db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:04:00.604443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea96473-de69-4635-b6ab-f8dd40aa7db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:04:00.605894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea96473-de69-4635-b6ab-f8dd40aa7db5 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:04:00.616186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 614/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:04:10.258668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:04:10.611874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:28.344121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded592-4300-4938-ae0a-3a653f7ec46c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.344765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded592-4300-4938-ae0a-3a653f7ec46c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.344765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded592-4300-4938-ae0a-3a653f7ec46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.383262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6bded592-4300-4938-ae0a-3a653f7ec46c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.384519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6bded592-4300-4938-ae0a-3a653f7ec46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.397919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 603/1217] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:28.406521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1df20-8e08-48b7-b349-8226ad5f9624 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.407749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1df20-8e08-48b7-b349-8226ad5f9624 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.408263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1df20-8e08-48b7-b349-8226ad5f9624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.408473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87dd65-6a26-4b4e-b443-8fcd4fd2f0e4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.408769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87dd65-6a26-4b4e-b443-8fcd4fd2f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.409049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87dd65-6a26-4b4e-b443-8fcd4fd2f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.435447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b1e1df20-8e08-48b7-b349-8226ad5f9624 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.437721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b1e1df20-8e08-48b7-b349-8226ad5f9624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.439197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6e87dd65-6a26-4b4e-b443-8fcd4fd2f0e4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.440388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6e87dd65-6a26-4b4e-b443-8fcd4fd2f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.453829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 615/1218] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.457145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 604/1219] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:28.470231 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332a90-0a19-44f5-8c98-64b035e74b89 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.470452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1df20-8e08-48b7-b349-8226ad5f9624 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:28.470755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332a90-0a19-44f5-8c98-64b035e74b89 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.471257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332a90-0a19-44f5-8c98-64b035e74b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.483243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1df20-8e08-48b7-b349-8226ad5f9624 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:28.494166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:28.494793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.495083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.495361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.496019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:28.496326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:28.498184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:28.505119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-de332a90-0a19-44f5-8c98-64b035e74b89 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.513374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-de332a90-0a19-44f5-8c98-64b035e74b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.517257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 616/1220] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:28.524685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 605/1221] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:28.525265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:28.529031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de332a90-0a19-44f5-8c98-64b035e74b89 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:28.540571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eac1a5-99e1-41c3-ad21-59fbc6dbe91a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:28.542717 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de332a90-0a19-44f5-8c98-64b035e74b89 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:28.552443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac1878-e8fe-4086-bd28-aaf165ec65e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:28.553067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1878-e8fe-4086-bd28-aaf165ec65e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.553359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1878-e8fe-4086-bd28-aaf165ec65e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.553636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac1878-e8fe-4086-bd28-aaf165ec65e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.554204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:28.554354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac1878-e8fe-4086-bd28-aaf165ec65e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:28.554894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.555104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.555367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-c9ac1878-e8fe-4086-bd28-aaf165ec65e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:05:28.555367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 20:05:28.555367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 20:05:28.555630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.556543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:28.556543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:28.557425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac1878-e8fe-4086-bd28-aaf165ec65e9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:28.557806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:05:28.557806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 20:05:28.557806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 20:05:28.558319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:28.580582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 606/1222] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:05:28.589489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:28.616386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6054db-ec9b-485c-b070-92005450012c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:28.636549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f4b6d-f191-41a7-a6b5-37d82cf53c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:28.637391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f4b6d-f191-41a7-a6b5-37d82cf53c87 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.637675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f4b6d-f191-41a7-a6b5-37d82cf53c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.638135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f4b6d-f191-41a7-a6b5-37d82cf53c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.638686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f4b6d-f191-41a7-a6b5-37d82cf53c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:28.641682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f4b6d-f191-41a7-a6b5-37d82cf53c87 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:28.645212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 617/1223] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:28.650861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc311-d444-4af3-9fbe-f93009d10ec5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.651264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc311-d444-4af3-9fbe-f93009d10ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.651695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc311-d444-4af3-9fbe-f93009d10ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.683607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-41ecc311-d444-4af3-9fbe-f93009d10ec5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.685299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-41ecc311-d444-4af3-9fbe-f93009d10ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.713419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 607/1224] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:28.715200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8424-4cc7-432a-9010-153966f11264 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.715662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8424-4cc7-432a-9010-153966f11264 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.716197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8424-4cc7-432a-9010-153966f11264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.744649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b45d8424-4cc7-432a-9010-153966f11264 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.745866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b45d8424-4cc7-432a-9010-153966f11264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.766129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 618/1225] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.771000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecc311-d444-4af3-9fbe-f93009d10ec5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:28.776827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecc311-d444-4af3-9fbe-f93009d10ec5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:28.806822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 608/1226] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.815299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c4113-223a-42d2-adcb-d23d838180b9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.815834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c4113-223a-42d2-adcb-d23d838180b9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.816133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c4113-223a-42d2-adcb-d23d838180b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.834477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:28.835084 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.835367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.835640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.836266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:28.836519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ea5c4113-223a-42d2-adcb-d23d838180b9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.837794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ea5c4113-223a-42d2-adcb-d23d838180b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.838214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:28.846418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 609/1227] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.847751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd774-1455-4925-a08c-87fb217b9906 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.848039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd774-1455-4925-a08c-87fb217b9906 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.848316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd774-1455-4925-a08c-87fb217b9906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.866031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 619/1228] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:28.866031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:28.873025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-835bd774-1455-4925-a08c-87fb217b9906 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.873323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0848d8-7ba9-4054-bfcc-9f474c918aa1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:28.874450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-835bd774-1455-4925-a08c-87fb217b9906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.878104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6733b-d5d2-400a-ac3f-caa62beebd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:28.878701 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6733b-d5d2-400a-ac3f-caa62beebd9d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.878982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6733b-d5d2-400a-ac3f-caa62beebd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.879258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6733b-d5d2-400a-ac3f-caa62beebd9d admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.879874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6733b-d5d2-400a-ac3f-caa62beebd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:28.881774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6733b-d5d2-400a-ac3f-caa62beebd9d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:28.882453 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 610/1229] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.883702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fd64f-9119-44f5-8c50-d39f19178546 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.883992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fd64f-9119-44f5-8c50-d39f19178546 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.884294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fd64f-9119-44f5-8c50-d39f19178546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.904147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 620/1230] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:28.904147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679af6ec-e55d-44da-a259-29b874262001 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.904147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679af6ec-e55d-44da-a259-29b874262001 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.904147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679af6ec-e55d-44da-a259-29b874262001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.908459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9d6fd64f-9119-44f5-8c50-d39f19178546 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.908459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9d6fd64f-9119-44f5-8c50-d39f19178546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.916164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 611/1231] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.917479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646d757-25fe-407a-b6fb-110156f3fe37 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.917736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646d757-25fe-407a-b6fb-110156f3fe37 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.918030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646d757-25fe-407a-b6fb-110156f3fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.926281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-679af6ec-e55d-44da-a259-29b874262001 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.927500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-679af6ec-e55d-44da-a259-29b874262001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.935366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 621/1232] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.937312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e0c2-f39f-4ed0-ae46-f6f8f51a9486 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.937575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e0c2-f39f-4ed0-ae46-f6f8f51a9486 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.937845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e0c2-f39f-4ed0-ae46-f6f8f51a9486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.944088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e646d757-25fe-407a-b6fb-110156f3fe37 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.945425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e646d757-25fe-407a-b6fb-110156f3fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.953672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 612/1233] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.954989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6b11-45d5-45f1-81db-65003f07ebbb None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.955347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6b11-45d5-45f1-81db-65003f07ebbb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.955684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6b11-45d5-45f1-81db-65003f07ebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.961546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3dc3e0c2-f39f-4ed0-ae46-f6f8f51a9486 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.962839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3dc3e0c2-f39f-4ed0-ae46-f6f8f51a9486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.971834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 622/1234] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.972621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3e0c2-f39f-4ed0-ae46-f6f8f51a9486 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:28.976229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c25a6b11-45d5-45f1-81db-65003f07ebbb None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:28.977418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c25a6b11-45d5-45f1-81db-65003f07ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:28.982158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3e0c2-f39f-4ed0-ae46-f6f8f51a9486 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:28.985505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 613/1235] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:28.986797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca573c-950c-47b3-8a19-9b442646d5ec None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.987178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:28.987310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca573c-950c-47b3-8a19-9b442646d5ec None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.987646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca573c-950c-47b3-8a19-9b442646d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.987752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:28.988028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:28.988301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:28.989139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:28.990648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:28.992839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:29.003373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 623/1236] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:29.004632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.008465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e6ca573c-950c-47b3-8a19-9b442646d5ec None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:29.009658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e6ca573c-950c-47b3-8a19-9b442646d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:29.014423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093579e-6484-427d-910d-5b2b6ebe912e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.017660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 614/1237] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:29.018886 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809412e-9839-4125-9215-325e59e84387 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.019171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809412e-9839-4125-9215-325e59e84387 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.019446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809412e-9839-4125-9215-325e59e84387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.023106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d81b59-159c-4bef-8663-f9221bd867f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.023704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d81b59-159c-4bef-8663-f9221bd867f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.023990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d81b59-159c-4bef-8663-f9221bd867f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.024268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d81b59-159c-4bef-8663-f9221bd867f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.024903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d81b59-159c-4bef-8663-f9221bd867f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.026522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d81b59-159c-4bef-8663-f9221bd867f7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.037306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 624/1238] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:29.038605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac90d0-1039-4dc3-8a81-5039340db85a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.038711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f809412e-9839-4125-9215-325e59e84387 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:29.038901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac90d0-1039-4dc3-8a81-5039340db85a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.039170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac90d0-1039-4dc3-8a81-5039340db85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.039819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f809412e-9839-4125-9215-325e59e84387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:29.048497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 615/1239] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:29.052193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809412e-9839-4125-9215-325e59e84387 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.059478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-34ac90d0-1039-4dc3-8a81-5039340db85a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:29.060921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-34ac90d0-1039-4dc3-8a81-5039340db85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:29.061413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809412e-9839-4125-9215-325e59e84387 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.066020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.066681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.066921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.067198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.067841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:29.068145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.068996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 625/1240] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:29.072600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.072722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac90d0-1039-4dc3-8a81-5039340db85a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.082223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac90d0-1039-4dc3-8a81-5039340db85a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.082460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 616/1241] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:29.083157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.086867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.087462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.087743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.088011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.088647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:29.088949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.090672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.092845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a84226-9725-4cc5-bcca-1334c708e029 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.098292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.098828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.099114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.099390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.100042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:29.100352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.101923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.104184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 626/1242] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:29.104997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.114638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26a4f-ac9c-45f0-ad4f-fdbc3cc9c491 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.119217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.126532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 617/1243] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:29.126685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.126685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.126685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.126974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.127075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.127075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.130314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c05a1-63cc-47a7-9f22-997557e75354 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.134959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.135541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.135824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.136180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.136523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 627/1244] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:29.136827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:29.137275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.137401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.138875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.149854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbc0a-6716-4391-b4c8-47a4a40a93da admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.151703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 618/1245] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:29.152664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.154594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.155176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.155459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.155813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.156465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.158127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.163233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b74515-bcba-47e9-b911-1643ea69223f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.167915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.168493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.168778 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.168889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 628/1246] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:29.169695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.172725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.173381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:29.173692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.175296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.180003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68540c-2abf-4779-b088-b2e24963e952 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.184714 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.185290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.185574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.186139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.186807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:29.187146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.192805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 619/1247] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:29.192805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.193004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.199436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191585-15b9-4afb-822b-68cbbfcba3ed admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.204539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 629/1248] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:29.204714 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.205481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.206180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.206469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.206748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.207377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.209270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.214141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:29.215617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c9de3-a84c-4d37-aca7-9d9436b51569 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.220957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.221540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.221825 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.222294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.222913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.224788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.239427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 620/1249] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.240412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.258673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 630/1250] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.258673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.303233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befa2e7-3e70-40bb-8fe9-1d708dea7f1d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.326186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9c83f-e2c6-4ef9-b6c6-02a5b4971ff5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.332137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.332799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.333083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.333360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] PATH_INFO: `/v3/projects/da648bc2c767426cb2a0a95769cec65a/users/bdb1d2159840433084befa7969c4d0a2/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.348806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da648bc2c767426cb2a0a95769cec65a, user_id=bdb1d2159840433084befa7969c4d0a2, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.351426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.365011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 631/1251] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:29 2022] PUT /identity/v3/projects/da648bc2c767426cb2a0a95769cec65a/users/bdb1d2159840433084befa7969c4d0a2/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:29.366892 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.368165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.368831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.369071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.369325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.369963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.371886 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.401252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 621/1252] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.403954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.421009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:29.433008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41eab-648e-4595-8394-da3881ad3580 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.467923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91b6d9-54ad-4577-95f3-c19116a4d603 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.472937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.473598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.473884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.474191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] PATH_INFO: `/v3/projects/d389e68b0e3d443c80ee4063758d51dc/users/5c7a939da3c34d418d768cb7bdf9920a/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.489121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d389e68b0e3d443c80ee4063758d51dc, user_id=5c7a939da3c34d418d768cb7bdf9920a, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.489512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.490147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.490433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.490711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.491345 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.491815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.493248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.501553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:29.506385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 622/1253] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:29 2022] PUT /identity/v3/projects/d389e68b0e3d443c80ee4063758d51dc/users/5c7a939da3c34d418d768cb7bdf9920a/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:29.507628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.523107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 632/1254] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.523909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.576735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca241f1-6045-4be8-8e1a-33a55e828789 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.586503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea9f6d-3824-43dc-868e-a0337c625306 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.591169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.591766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.592051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.592323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.592959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.595851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.627252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 633/1255] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.627982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.638315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.638937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.639221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.639498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.640207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.642204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.669190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 623/1256] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.670282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.692470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906b4f-8c5e-46a2-a439-90da7bffde41 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.704609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:29.734228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215b9c7-40ab-4dcf-b238-c31f3f35e1ad admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.738933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e0ece-22bb-4fa0-8458-61b4e2833c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.739539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0ece-22bb-4fa0-8458-61b4e2833c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.739820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0ece-22bb-4fa0-8458-61b4e2833c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.740093 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0ece-22bb-4fa0-8458-61b4e2833c8c admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.740721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e0ece-22bb-4fa0-8458-61b4e2833c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.741728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-288e0ece-22bb-4fa0-8458-61b4e2833c8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:05:29.741728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 20:05:29.741728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 20:05:29.742973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e0ece-22bb-4fa0-8458-61b4e2833c8c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.750219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.750965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.751422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.751709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.752345 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.754316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.766684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 624/1257] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.770402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ed5c-32b9-4bff-9647-4311ccc65c82 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.770402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ed5c-32b9-4bff-9647-4311ccc65c82 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.770402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ed5c-32b9-4bff-9647-4311ccc65c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.777664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 634/1258] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.778525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.788901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954991-459b-4f07-a46c-4001568d9a31 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.793525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332cacf-bb19-411a-ad25-19f6bc6f2570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.794138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cacf-bb19-411a-ad25-19f6bc6f2570 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.794418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cacf-bb19-411a-ad25-19f6bc6f2570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.794688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cacf-bb19-411a-ad25-19f6bc6f2570 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.795301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332cacf-bb19-411a-ad25-19f6bc6f2570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.797243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332cacf-bb19-411a-ad25-19f6bc6f2570 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.798379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8595ed5c-32b9-4bff-9647-4311ccc65c82 None None] MFA Rules not processed for user `bdb1d2159840433084befa7969c4d0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:29.799610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8595ed5c-32b9-4bff-9647-4311ccc65c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:29.808638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:29.820217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 635/1259] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.823494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6efae-4045-4915-bb48-72c26ac85f60 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.823494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6efae-4045-4915-bb48-72c26ac85f60 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.823494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6efae-4045-4915-bb48-72c26ac85f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.841176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2eb6efae-4045-4915-bb48-72c26ac85f60 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:29.842439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2eb6efae-4045-4915-bb48-72c26ac85f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:29.850111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 636/1260] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:29.850937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6efae-4045-4915-bb48-72c26ac85f60 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.862028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6efae-4045-4915-bb48-72c26ac85f60 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.866738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.867327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.867624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.867893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.868511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.869293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 625/1261] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:29.870597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.871171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ed5c-32b9-4bff-9647-4311ccc65c82 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.882395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ed5c-32b9-4bff-9647-4311ccc65c82 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.889229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.889831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.891129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.891410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.892046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.893975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.898140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 637/1262] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.898140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.905899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea43a-00c1-47a2-999d-9984d1cc5507 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.910932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.911509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.911789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.912070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.912698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.914654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.916936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 626/1263] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/users => generated 279 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.917760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.931835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f79c0-b8e1-4741-9125-fec3f9a106b1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.936736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.937934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 638/1264] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:29.938054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.938270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.938544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.938745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.939237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.940832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.950359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ecf36-7787-4107-90bf-1988692dafdc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.951642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 627/1265] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:29.952297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.955827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.956420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.956697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.956967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.957603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.959627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.964901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac045a9f-d180-4414-9436-124feb9a1a9a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:29.969727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:29.970348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:29.970630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:29.970903 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:29.971536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:29.971859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 639/1266] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:29.973265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:29.975702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.987216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 628/1267] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:29.987216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:29.996936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173423-0770-472e-8f62-2087682bae69 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.002248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.002834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.003116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.003410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.004031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.005936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.033038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6030e-9136-4253-90ef-f8d9f8381441 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.033281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 629/1268] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:29 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:30.034041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.084155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.084762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.085044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.085317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.092752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:30.095365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7a41d-fcf8-43b4-890b-195aac0349fd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.095926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.097941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.100392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.100990 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.101270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.101541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.102229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.103793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.107972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 640/1269] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:30.109760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.115702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 630/1270] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.116354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.121925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9705b-b1cd-4c70-b08b-3a2d6ac1a08e service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.127628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ac568-691e-416f-b6db-3c6de14ed0e9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.128098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.128802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.129211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.129353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.129997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.131642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.133081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.133807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.134343 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.134504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.135139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.136795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.143474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 641/1271] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.144436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.152469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 631/1272] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.153305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.154834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c64bd-498d-42a2-8abf-868a15931022 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.160591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.161272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.161555 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.161834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.162506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.164100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.167056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ccf97-f0b9-4ab5-b3bb-e638cc646f76 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.173001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.173681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.174032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.174507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.174633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 642/1273] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.175409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.175556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.177278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.185451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780a22b-919f-4ffb-bd5d-009029b61073 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.190887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 632/1274] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.191845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.194324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.195017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.195369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.195698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.196432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.198104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.204155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bf4d5-afd7-487b-969d-6ed3b0e495b7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.210221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 643/1275] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.211046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.213154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.214026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.214514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.214758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.215680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.217826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.224027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01328e-ede1-42b2-8250-cadbc61b8522 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.228670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.229483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.229684 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.229948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.230620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.232288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.245853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 633/1276] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:30 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:30.245853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.246632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 644/1277] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.247606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.258713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bfec7-546e-485c-8edd-46afd9513448 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.259634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637562b-c9b2-4d5f-865a-0ee0b000944b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.263413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.264016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.264299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.264426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.264617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.264900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.265712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.265957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.266110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.266728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.267583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.268898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.270523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:30.283031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 645/1278] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.283031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.284088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 634/1279] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.284088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.298550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6edb3-f92f-4774-a4c8-bebdb23039dd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.308359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.308843 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d336a-cf9f-4bab-acd3-45d83e79dbc4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.309027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.309304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.309586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] PATH_INFO: `/v3/projects/bb0a0e1471af4fe5b343f52818567fd6/users/66585fd9c7304bc08c419a49ac3476f4/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.316923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.317637 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.317908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.318337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] PATH_INFO: `/v3/projects/b3ab9c4ad37344b082ed508415ba4add/users/2c77f0bef97f4a3681f6f3d435efd9dd/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.326626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0a0e1471af4fe5b343f52818567fd6, user_id=66585fd9c7304bc08c419a49ac3476f4, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.329557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.335368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ab9c4ad37344b082ed508415ba4add, user_id=2c77f0bef97f4a3681f6f3d435efd9dd, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.338378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.348349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 646/1280] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:30 2022] PUT /identity/v3/projects/bb0a0e1471af4fe5b343f52818567fd6/users/66585fd9c7304bc08c419a49ac3476f4/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:30.349227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.358367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 635/1281] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:30 2022] PUT /identity/v3/projects/b3ab9c4ad37344b082ed508415ba4add/users/2c77f0bef97f4a3681f6f3d435efd9dd/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:30.362569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.424094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6bbef-2cde-4301-b083-ff19c4b45a22 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.440553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeef50-0c01-40e4-96c2-ae6607e80e93 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.447852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.448737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.449122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.449499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.458379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.461428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.475301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 636/1282] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:30.476259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.487575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d228cc-09f7-470a-8b06-a817258895d0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.494465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.495324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.495689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.496067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] PATH_INFO: `/v3/projects/6725b2f8a4f44b3cb9e1e5f5e3bf7bdf/users/1ff5294caf23474f8d5b12906fd87fdf/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.504757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.505696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.506165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.506653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] PATH_INFO: `/v3/projects/494f4f7794ba4edea007282badbf1a79/users/6a267973f5aa4e8a8d600cb90947447d/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.514650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6725b2f8a4f44b3cb9e1e5f5e3bf7bdf, user_id=1ff5294caf23474f8d5b12906fd87fdf, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.518661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.526476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494f4f7794ba4edea007282badbf1a79, user_id=6a267973f5aa4e8a8d600cb90947447d, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.529953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.543137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 637/1283] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:30 2022] PUT /identity/v3/projects/6725b2f8a4f44b3cb9e1e5f5e3bf7bdf/users/1ff5294caf23474f8d5b12906fd87fdf/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:30.544428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.558275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 647/1284] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:30 2022] PUT /identity/v3/projects/494f4f7794ba4edea007282badbf1a79/users/6a267973f5aa4e8a8d600cb90947447d/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:30.558275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.564476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:30.630040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff41a9-2c63-4c89-99ee-68033121560a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.636483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b416c-7a68-49cc-8380-c62e1a5dd6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.637053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b416c-7a68-49cc-8380-c62e1a5dd6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.637462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b416c-7a68-49cc-8380-c62e1a5dd6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.637612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d26fe-6da0-41ab-8f9e-469659ef2948 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.637839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b416c-7a68-49cc-8380-c62e1a5dd6f5 admin admin] PATH_INFO: `/v3/projects/e6b8ffc6ac844c339356c77881c7ea50/users/2e4843b52aa8440a8ec485d103932ecb/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.642641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f4fc2-e4cf-4763-9ebd-e6813510160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.643298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4fc2-e4cf-4763-9ebd-e6813510160e admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.643579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4fc2-e4cf-4763-9ebd-e6813510160e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.643854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f4fc2-e4cf-4763-9ebd-e6813510160e admin admin] PATH_INFO: `/v3/projects/f5083dd0dcf0410f9d84395958461fb4/users/6a5f0f3e841e444582463b9a44b79a34/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.654337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b416c-7a68-49cc-8380-c62e1a5dd6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b8ffc6ac844c339356c77881c7ea50, user_id=2e4843b52aa8440a8ec485d103932ecb, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.657170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b416c-7a68-49cc-8380-c62e1a5dd6f5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.661462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f4fc2-e4cf-4763-9ebd-e6813510160e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5083dd0dcf0410f9d84395958461fb4, user_id=6a5f0f3e841e444582463b9a44b79a34, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.665619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f4fc2-e4cf-4763-9ebd-e6813510160e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.674130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 638/1285] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:30 2022] PUT /identity/v3/projects/e6b8ffc6ac844c339356c77881c7ea50/users/2e4843b52aa8440a8ec485d103932ecb/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:30.675420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96e68-259d-4eda-8d9d-870562c9d5e4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.675705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96e68-259d-4eda-8d9d-870562c9d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.675982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96e68-259d-4eda-8d9d-870562c9d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.686835 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 648/1286] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:30 2022] PUT /identity/v3/projects/f5083dd0dcf0410f9d84395958461fb4/users/6a5f0f3e841e444582463b9a44b79a34/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:30.688839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8b488-0e1e-4f5a-9362-33f0ec16cc52 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.689360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8b488-0e1e-4f5a-9362-33f0ec16cc52 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.689855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8b488-0e1e-4f5a-9362-33f0ec16cc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.705252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-13e96e68-259d-4eda-8d9d-870562c9d5e4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:30.706680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-13e96e68-259d-4eda-8d9d-870562c9d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:30.713086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-78a8b488-0e1e-4f5a-9362-33f0ec16cc52 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:30.715051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-78a8b488-0e1e-4f5a-9362-33f0ec16cc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:30.730992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:30.784149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 639/1287] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:30.788129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e96e68-259d-4eda-8d9d-870562c9d5e4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:30.799502 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e96e68-259d-4eda-8d9d-870562c9d5e4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:30.804780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085841e-59a9-4844-83d7-700cfe6c0bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:30.805486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085841e-59a9-4844-83d7-700cfe6c0bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.805701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085841e-59a9-4844-83d7-700cfe6c0bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.805999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085841e-59a9-4844-83d7-700cfe6c0bf2 admin admin] PATH_INFO: `/v3/projects/d684b626c3fc49dca0d8e1e63dff32bc/users/80c93c860f354072b20c538044603f66/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.809752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 649/1288] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:30.813914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b30ed-adc4-4f69-9519-9ac8680743af None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.814336 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b30ed-adc4-4f69-9519-9ac8680743af None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.814684 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b30ed-adc4-4f69-9519-9ac8680743af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.829489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085841e-59a9-4844-83d7-700cfe6c0bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d684b626c3fc49dca0d8e1e63dff32bc, user_id=80c93c860f354072b20c538044603f66, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:30.833176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085841e-59a9-4844-83d7-700cfe6c0bf2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:30.843282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4a8b30ed-adc4-4f69-9519-9ac8680743af None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:30.845191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4a8b30ed-adc4-4f69-9519-9ac8680743af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:30.861533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 640/1289] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:30 2022] PUT /identity/v3/projects/d684b626c3fc49dca0d8e1e63dff32bc/users/80c93c860f354072b20c538044603f66/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:30.862904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44355-d6ea-4567-851a-2846906f0fca None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.863499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44355-d6ea-4567-851a-2846906f0fca None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.863787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44355-d6ea-4567-851a-2846906f0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.907059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-86f44355-d6ea-4567-851a-2846906f0fca None None] MFA Rules not processed for user `6a267973f5aa4e8a8d600cb90947447d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:30.909236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-86f44355-d6ea-4567-851a-2846906f0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:30.926232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 650/1290] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:30.930593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb737-45cf-41d4-bf45-52c42b6fdb60 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.930883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb737-45cf-41d4-bf45-52c42b6fdb60 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.931163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfb737-45cf-41d4-bf45-52c42b6fdb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:30.958025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1bbfb737-45cf-41d4-bf45-52c42b6fdb60 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:30.960289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1bbfb737-45cf-41d4-bf45-52c42b6fdb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:30.969563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 651/1291] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:30.970886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:30.971174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:30.971480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.015470 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 641/1292] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:31.016692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f44355-d6ea-4567-851a-2846906f0fca None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.018947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] MFA Rules not processed for user `6a5f0f3e841e444582463b9a44b79a34`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:31.020649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:31.037201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:31.112183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f44355-d6ea-4567-851a-2846906f0fca None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.116232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 652/1293] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:31.117410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.120271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.121026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.121288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:31.121485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.121993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.133927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.135805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.147921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51b2c-b4a4-4366-b58c-b1a4a6f2f7d5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.149235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 642/1294] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:31.150806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.151982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.152801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.153175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.153563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.164556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.166255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.166818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edba52d-2d61-4b07-901f-9171860565b4 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.172967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.173825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.174340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.174814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.175773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.177257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 653/1295] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:31.177956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.178296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.188013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33664ae-c334-4e7c-a2e3-e715fddb6393 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.192083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.193064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.193425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.193813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.195317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 643/1296] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:31.197001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.205177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.207257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.221171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 654/1297] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:31.222243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.226988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fbdb-d35a-48b5-8802-59805008d339 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.234646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346030-5310-4acc-a51b-cb576e4ebb22 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.238222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.238983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.239295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.240742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.241577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.242073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.242536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.242667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.243753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.249944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.271376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.275393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.293174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 655/1298] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:31 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:31.293174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.303023 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 644/1299] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:31.305276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.332094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a831e8-51f5-4ade-8960-685efcd91b2c service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.353173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:31.402611 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f4f8d-f592-4a7e-8db2-a9e6daca1971 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.410635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.411672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.412614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.412614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.414393 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.418195 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.460044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.461169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.461291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.461984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] PATH_INFO: `/v3/projects/d684b626c3fc49dca0d8e1e63dff32bc/users/80c93c860f354072b20c538044603f66/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.466588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d684b626c3fc49dca0d8e1e63dff32bc, user_id=80c93c860f354072b20c538044603f66, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.471045 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.485587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 656/1300] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:31 2022] POST /identity/v3/projects => generated 357 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:31.488304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 645/1301] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:31 2022] PUT /identity/v3/projects/d684b626c3fc49dca0d8e1e63dff32bc/users/80c93c860f354072b20c538044603f66/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:31.489552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.490114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.584554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:31.625112 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949213d-e28a-4cbe-b6bb-e54060491787 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.626222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e0dba-900a-4827-ac8e-e1634c81a47d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.632362 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff15058-0a75-49c0-85ac-9015d29ebcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.633114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff15058-0a75-49c0-85ac-9015d29ebcac admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.633411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff15058-0a75-49c0-85ac-9015d29ebcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.633702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff15058-0a75-49c0-85ac-9015d29ebcac admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.635136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff15058-0a75-49c0-85ac-9015d29ebcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.638187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff15058-0a75-49c0-85ac-9015d29ebcac admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.638377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.638959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.639241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.639513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.641996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.646670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.676869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 646/1302] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:31 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:31.678999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059d9c-f8b7-4018-ad94-d6898793c8c2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.679661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059d9c-f8b7-4018-ad94-d6898793c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.680483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059d9c-f8b7-4018-ad94-d6898793c8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.694118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 657/1303] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:31 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:31.699295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.718935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-19059d9c-f8b7-4018-ad94-d6898793c8c2 None None] MFA Rules not processed for user `80c93c860f354072b20c538044603f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:31.720804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-19059d9c-f8b7-4018-ad94-d6898793c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:31.724384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba090d-c3f0-4c25-9bb5-3ff06e95f100 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.734557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.735779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.737783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.738073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.739342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.743613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.775985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 658/1304] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:31.777201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.803377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8ae7-0736-46ac-a13c-5acebc84187d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.815786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.816409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.816688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.817014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.818611 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.822272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.826903 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 647/1305] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:31.828661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059d9c-f8b7-4018-ad94-d6898793c8c2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.841113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059d9c-f8b7-4018-ad94-d6898793c8c2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:31.848629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:31.850197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:31.850530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:31.850910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] PATH_INFO: `/v3/projects/0701ff4ee3ae4741bc01d3fb557657f0/users/fbff5d41c72e4f7f988893dfd484ace4/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:31.860320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 659/1306] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:31.862301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.869593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701ff4ee3ae4741bc01d3fb557657f0, user_id=fbff5d41c72e4f7f988893dfd484ace4, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:31.872484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:31.876814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:31.900763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 648/1307] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:31 2022] PUT /identity/v3/projects/0701ff4ee3ae4741bc01d3fb557657f0/users/fbff5d41c72e4f7f988893dfd484ace4/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:31.901701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:31.991859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d145f-599b-4035-a4cf-0315a296c762 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.000764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead193ae-d84a-4d17-bfcb-c7cd4ecafd84 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.007355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.007823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.008112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.008449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] PATH_INFO: `/v3/projects/8d2ada08b7b74035bd2e183aaa70b9d2/users/7de71416d6d149fd93576f2e851e8295/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.035931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2ada08b7b74035bd2e183aaa70b9d2, user_id=7de71416d6d149fd93576f2e851e8295, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.039062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.058882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 649/1308] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:31 2022] PUT /identity/v3/projects/8d2ada08b7b74035bd2e183aaa70b9d2/users/7de71416d6d149fd93576f2e851e8295/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:32.059964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:32.101387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.102068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.102381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.102657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.154110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969728e0-c9e7-45bb-8dfd-237e4b854208 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.160782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.161572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.161700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.161955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.162654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.164522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.181250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 650/1309] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:32.185921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:32.199686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae433499-b2a7-44f2-a50a-5fb75bc18a87 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.207365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.208510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.208794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.209132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.210847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.213069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.234045 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 651/1310] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:32.235260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:32.243585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.245175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.258261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86edef-e0be-42ac-bd37-de3ee36b6f15 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.266673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb00f6-53f2-4052-93cc-98a1050e304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.267437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb00f6-53f2-4052-93cc-98a1050e304b admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.267998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb00f6-53f2-4052-93cc-98a1050e304b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.268653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb00f6-53f2-4052-93cc-98a1050e304b admin admin] PATH_INFO: `/v3/projects/0701ff4ee3ae4741bc01d3fb557657f0/users/fbff5d41c72e4f7f988893dfd484ace4/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.271184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 660/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:32.271586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb00f6-53f2-4052-93cc-98a1050e304b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701ff4ee3ae4741bc01d3fb557657f0, user_id=fbff5d41c72e4f7f988893dfd484ace4, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.275892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb00f6-53f2-4052-93cc-98a1050e304b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.285621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:32.303912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 652/1312] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:32 2022] PUT /identity/v3/projects/0701ff4ee3ae4741bc01d3fb557657f0/users/fbff5d41c72e4f7f988893dfd484ace4/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:32.308390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24658598-9222-4300-b610-5f2df5cd681f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.308911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24658598-9222-4300-b610-5f2df5cd681f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.309428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24658598-9222-4300-b610-5f2df5cd681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.321420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8ef27-c90a-443c-b502-23b4a1f69316 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.360665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-24658598-9222-4300-b610-5f2df5cd681f None None] MFA Rules not processed for user `fbff5d41c72e4f7f988893dfd484ace4`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:32.362570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-24658598-9222-4300-b610-5f2df5cd681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:32.389494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:32.435177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:32.494638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.503160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 653/1313] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:32.504179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24658598-9222-4300-b610-5f2df5cd681f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:32.507858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.509287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.509646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] PATH_INFO: `/v3/projects/8d2ada08b7b74035bd2e183aaa70b9d2/users/7de71416d6d149fd93576f2e851e8295/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.515577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2ada08b7b74035bd2e183aaa70b9d2, user_id=7de71416d6d149fd93576f2e851e8295, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.522997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.564928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 661/1314] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:32 2022] PUT /identity/v3/projects/8d2ada08b7b74035bd2e183aaa70b9d2/users/7de71416d6d149fd93576f2e851e8295/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:32.578099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:32.611939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24658598-9222-4300-b610-5f2df5cd681f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.730319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f589c07-5810-4da6-bb11-aec4d8b17163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.730319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589c07-5810-4da6-bb11-aec4d8b17163 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.730319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589c07-5810-4da6-bb11-aec4d8b17163 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.730319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589c07-5810-4da6-bb11-aec4d8b17163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.775570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9908057-ea9d-44b9-b08e-5bd7c39f0990 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:32.788706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:32.790623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.790907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.791205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.816699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f589c07-5810-4da6-bb11-aec4d8b17163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.818497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f589c07-5810-4da6-bb11-aec4d8b17163 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.836008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 654/1315] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:32.836008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21d564-7526-44e0-aa04-7ae6a83a8c9c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:32.836008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21d564-7526-44e0-aa04-7ae6a83a8c9c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:32.839465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21d564-7526-44e0-aa04-7ae6a83a8c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:32.908001 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9b21d564-7526-44e0-aa04-7ae6a83a8c9c None None] MFA Rules not processed for user `7de71416d6d149fd93576f2e851e8295`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:32.908841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9b21d564-7526-44e0-aa04-7ae6a83a8c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:32.990597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:32.992438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:32.995185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:33.015584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 662/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:33.084103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 655/1317] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:33.101512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:33.122760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0c33-495c-4cf3-9ec1-9d84d83b051c service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:33.131132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:33.131994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:33.132467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:33.132929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:33.167532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:33.170687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:33.210993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c277a-78be-42de-9483-ac42df051dfe None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:33.211289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c277a-78be-42de-9483-ac42df051dfe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:33.211739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c277a-78be-42de-9483-ac42df051dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:33.229270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 663/1318] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:33.251482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-550c277a-78be-42de-9483-ac42df051dfe None None] MFA Rules not processed for user `1ff5294caf23474f8d5b12906fd87fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:33.252825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-550c277a-78be-42de-9483-ac42df051dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:33.434795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 656/1319] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:33.436114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c277a-78be-42de-9483-ac42df051dfe None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:33.436283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:33.450110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c277a-78be-42de-9483-ac42df051dfe None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:33.455239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:33.455877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:33.456160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:33.456435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:33.551738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:33.565254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b22a11-cc92-4dc6-89c0-fa52624fd9ca service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:33.585922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:33.587449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:33.588017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:33.588461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:33.589831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:33.593623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:33.615853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:33.617555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:33.645148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 657/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:33.646111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:33.667989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc700b3-f505-4b25-a929-92f0504ca8ca service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:33.678975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:33.679647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:33.681650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:33.681945 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:33.702056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 664/1321] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:33 2022] POST /identity/v3/projects => generated 403 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:05:33.712568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:33.837672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:33.841486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:33.850775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:33.866667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 658/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:33.878840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce317d3-9fb6-4c97-9ec0-2af39810964d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:33.896088 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:33.896911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:33.897301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:33.897514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:33.898550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:33.900228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:33.962405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 665/1323] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:33 2022] POST /identity/v3/users => generated 308 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:33.969457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:33.990179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6254d6-2c0b-4aa5-9e99-1e6e34a5fd3e service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:34.002796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:34.004445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:34.004744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:34.005003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:34.005668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:34.011815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:34.046820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 659/1324] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:34.047826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:34.061055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5f95-8abf-4f25-834e-5aff6c6e9813 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:34.076783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:34.079558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:34.081121 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:34.081764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] PATH_INFO: `/v3/projects/d9af3d65ba0146dfb922967ea9c0d83f/users/ce3a9bbff04a4d3e99343b95bb51a681/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:34.130381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9af3d65ba0146dfb922967ea9c0d83f, user_id=ce3a9bbff04a4d3e99343b95bb51a681, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:34.133662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:34.153614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 666/1325] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:34 2022] PUT /identity/v3/projects/d9af3d65ba0146dfb922967ea9c0d83f/users/ce3a9bbff04a4d3e99343b95bb51a681/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:05:34.158617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:34.175042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4c251-4706-47bb-82f5-58abfcf33c97 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:34.248050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:34.248677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:34.249031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:34.249877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:34.252769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:34.254950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:34.274153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 660/1326] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:34.275505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:34.293972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237d729-4445-4734-9054-ee2a9dfcba42 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:34.299989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781c0d1-cff3-464f-8370-bd356dcdfc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:34.301949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c0d1-cff3-464f-8370-bd356dcdfc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:34.301949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c0d1-cff3-464f-8370-bd356dcdfc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:34.301949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781c0d1-cff3-464f-8370-bd356dcdfc00 admin admin] PATH_INFO: `/v3/projects/d9af3d65ba0146dfb922967ea9c0d83f/users/ce3a9bbff04a4d3e99343b95bb51a681/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:34.304653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781c0d1-cff3-464f-8370-bd356dcdfc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9af3d65ba0146dfb922967ea9c0d83f, user_id=ce3a9bbff04a4d3e99343b95bb51a681, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:34.325247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781c0d1-cff3-464f-8370-bd356dcdfc00 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:34.355357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 667/1327] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:34 2022] PUT /identity/v3/projects/d9af3d65ba0146dfb922967ea9c0d83f/users/ce3a9bbff04a4d3e99343b95bb51a681/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:36.157503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:36.179448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167812af-af4f-46d5-a13d-78418e34c637 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:36.334554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:36.335020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:36.335312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:36.335706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] PATH_INFO: `/v3/users/bdb1d2159840433084befa7969c4d0a2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:36.337082 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb1d2159840433084befa7969c4d0a2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:36.340183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:36.409005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb1d2159840433084befa7969c4d0a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:36.422991 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb1d2159840433084befa7969c4d0a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:36.436261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb1d2159840433084befa7969c4d0a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:36.436959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb1d2159840433084befa7969c4d0a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:36.464837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb1d2159840433084befa7969c4d0a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:36.480697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 661/1328] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:36 2022] DELETE /identity/v3/users/bdb1d2159840433084befa7969c4d0a2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:36.484435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c121-8b2c-45a1-a7c5-ac3b433f14e4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:36.485087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c121-8b2c-45a1-a7c5-ac3b433f14e4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:36.485661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c121-8b2c-45a1-a7c5-ac3b433f14e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:36.529110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5832c121-8b2c-45a1-a7c5-ac3b433f14e4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:36.532382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5832c121-8b2c-45a1-a7c5-ac3b433f14e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:36.690105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 668/1329] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:36.715738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:36.719140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:36.726954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:36.879283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148009-090d-4381-9c54-a3f948d8fdb8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:36.897565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:36.898578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:36.899100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:36.899598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:36.927742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:36.929206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:36.965814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 662/1330] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:38.191298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4368ae-6e9f-4ebc-9a69-8f03bc85c867 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:38.191854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4368ae-6e9f-4ebc-9a69-8f03bc85c867 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:38.191854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4368ae-6e9f-4ebc-9a69-8f03bc85c867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:38.265590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2e4368ae-6e9f-4ebc-9a69-8f03bc85c867 None None] MFA Rules not processed for user `ce3a9bbff04a4d3e99343b95bb51a681`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:38.267869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2e4368ae-6e9f-4ebc-9a69-8f03bc85c867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:38.329250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:38.458701 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 669/1331] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:39.447702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:39.449566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:39.477030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8c1a7-dc64-4004-aed1-278b40b9b4b3 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:39.490785 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:39.491509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:39.491798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:39.492081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] PATH_INFO: `/v3/projects/da648bc2c767426cb2a0a95769cec65a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:39.502487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da648bc2c767426cb2a0a95769cec65a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:39.503544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:05:39.503544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 23 20:05:39.503544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: Oct 23 20:05:39.504918 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:39.648403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da648bc2c767426cb2a0a95769cec65a', 'request_id': 'req-8ed1e642-be92-4315-ac19-840bce9afc1c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:39.679189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da648bc2c767426cb2a0a95769cec65a', 'request_id': 'req-8ed1e642-be92-4315-ac19-840bce9afc1c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:39.693491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da648bc2c767426cb2a0a95769cec65a', 'request_id': 'req-8ed1e642-be92-4315-ac19-840bce9afc1c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:39.713664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] The token cache is being invalidate because project da648bc2c767426cb2a0a95769cec65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:05:39.713968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:39.714680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:39.718786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 663/1332] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:05:39 2022] DELETE /identity/v3/projects/da648bc2c767426cb2a0a95769cec65a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:39.723191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4368ae-6e9f-4ebc-9a69-8f03bc85c867 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:39.751787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4368ae-6e9f-4ebc-9a69-8f03bc85c867 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:39.956122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:39.958634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:39.959568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:39.960718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] PATH_INFO: `/v3/users/80c93c860f354072b20c538044603f66` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:39.963794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c93c860f354072b20c538044603f66)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:39.968002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 20:05:39.968002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 23 20:05:39.968002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: Oct 23 20:05:39.980484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:40.221260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c93c860f354072b20c538044603f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:40.293301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c93c860f354072b20c538044603f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:40.295493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c93c860f354072b20c538044603f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:40.297970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c93c860f354072b20c538044603f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:40.319409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-895e60b1-ae2b-4020-92c3-231b63d98ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c93c860f354072b20c538044603f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:40.366055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 670/1333] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:39 2022] DELETE /identity/v3/users/80c93c860f354072b20c538044603f66 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:42.513992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:42.515825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:42.547354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1e642-be92-4315-ac19-840bce9afc1c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:42.745292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:42.746662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:42.751842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:42.752346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] PATH_INFO: `/v3/projects/d684b626c3fc49dca0d8e1e63dff32bc` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:42.754611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d684b626c3fc49dca0d8e1e63dff32bc)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:42.764269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:42.899779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:42.995843 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd684b626c3fc49dca0d8e1e63dff32bc', 'request_id': 'req-85bc9842-cc69-4e58-a8f7-1722f6f45e80'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:43.012483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd684b626c3fc49dca0d8e1e63dff32bc', 'request_id': 'req-85bc9842-cc69-4e58-a8f7-1722f6f45e80'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:43.056164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd684b626c3fc49dca0d8e1e63dff32bc', 'request_id': 'req-85bc9842-cc69-4e58-a8f7-1722f6f45e80'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:43.104815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] The token cache is being invalidate because project d684b626c3fc49dca0d8e1e63dff32bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:05:43.105117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:43.112188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-85bc9842-cc69-4e58-a8f7-1722f6f45e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:43.116295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 664/1334] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:05:42 2022] DELETE /identity/v3/projects/d684b626c3fc49dca0d8e1e63dff32bc => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:43.123252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6276-6273-4ad3-b19b-4f74057e9c30 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.123948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6276-6273-4ad3-b19b-4f74057e9c30 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.123948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6276-6273-4ad3-b19b-4f74057e9c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.173628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0dbf6276-6273-4ad3-b19b-4f74057e9c30 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:43.180646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0dbf6276-6273-4ad3-b19b-4f74057e9c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:43.216197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73139-56ef-45df-afcd-735e5d99843c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.216452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73139-56ef-45df-afcd-735e5d99843c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.216703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73139-56ef-45df-afcd-735e5d99843c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.220295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 665/1335] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:05:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:05:43.251928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.252305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.252580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.293400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:43.307544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:43.311936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:43.360380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 671/1336] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:43.369374 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669113-a7d9-4796-9aeb-22b31e97edc8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.369926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669113-a7d9-4796-9aeb-22b31e97edc8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.370886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669113-a7d9-4796-9aeb-22b31e97edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.411061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-eb669113-a7d9-4796-9aeb-22b31e97edc8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:43.433113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eb669113-a7d9-4796-9aeb-22b31e97edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:43.455406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 672/1337] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:43.457260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669113-a7d9-4796-9aeb-22b31e97edc8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:43.474962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669113-a7d9-4796-9aeb-22b31e97edc8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:43.493228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:43.494726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.495823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.496911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.497192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 666/1338] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:43.499087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:43.499729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:43.502375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:43.535638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:43.557443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 673/1339] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:43.557443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:43.559326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:43.581391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae1b46-3675-41e5-89ff-13282b196b79 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:43.586804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9f6ce-d409-4565-9bd8-853a4e3a2a30 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:43.594557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a7df-9def-46ec-8da5-a6b692a5b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:43.595213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a7df-9def-46ec-8da5-a6b692a5b0fb admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.595607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a7df-9def-46ec-8da5-a6b692a5b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.595970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a7df-9def-46ec-8da5-a6b692a5b0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.596705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:43.596845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a7df-9def-46ec-8da5-a6b692a5b0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:43.606738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a7df-9def-46ec-8da5-a6b692a5b0fb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:43.621106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.621280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.621574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.650176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:43.652254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:43.657985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 674/1340] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:43 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:43.664757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbf189-c90c-4148-b24f-08bc824d1640 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.665239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbf189-c90c-4148-b24f-08bc824d1640 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.665537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbf189-c90c-4148-b24f-08bc824d1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.688400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 667/1341] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:43.695313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:43.726764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7228041-f2d9-49e0-a0c1-eaed7697b8cc service placement] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:43.750790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-87fbf189-c90c-4148-b24f-08bc824d1640 None None] MFA Rules not processed for user `5c7a939da3c34d418d768cb7bdf9920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:43.752611 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-87fbf189-c90c-4148-b24f-08bc824d1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:43.867240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:43.867921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.869563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.870039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.870650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:43.873123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:43.919233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 668/1342] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:43 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:43.929811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:43.956540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 675/1343] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:43.960589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7efa99-f623-48ac-ae10-48c74554d487 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:43.965736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7710156-cee6-4a26-a250-b0a7607a7d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:43.967439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7710156-cee6-4a26-a250-b0a7607a7d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:43.969593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7710156-cee6-4a26-a250-b0a7607a7d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:43.969593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7710156-cee6-4a26-a250-b0a7607a7d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:43.969593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7710156-cee6-4a26-a250-b0a7607a7d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:43.971826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7710156-cee6-4a26-a250-b0a7607a7d3b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:43.993538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 669/1344] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:43.995111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbf189-c90c-4148-b24f-08bc824d1640 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:44.019294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbf189-c90c-4148-b24f-08bc824d1640 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:44.030822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f86cf5-5a15-4855-a7dd-9ea69dcedd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:44.031380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677746-264a-445f-b07c-be70bd106950 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:44.031660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86cf5-5a15-4855-a7dd-9ea69dcedd9e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:44.031779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677746-264a-445f-b07c-be70bd106950 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:44.032143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86cf5-5a15-4855-a7dd-9ea69dcedd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:44.032249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677746-264a-445f-b07c-be70bd106950 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:44.032490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86cf5-5a15-4855-a7dd-9ea69dcedd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:44.033232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f86cf5-5a15-4855-a7dd-9ea69dcedd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:44.036042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 670/1345] 10.222.0.18 () {54 vars in 961 bytes} [Sun Oct 23 20:05:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:05:44.038052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f86cf5-5a15-4855-a7dd-9ea69dcedd9e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:44.073061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 676/1346] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:44.074327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677746-264a-445f-b07c-be70bd106950 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:44.090609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710e93-34bb-46cb-b5cc-ec54bf6ac833 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:44.090870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710e93-34bb-46cb-b5cc-ec54bf6ac833 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:44.091091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710e93-34bb-46cb-b5cc-ec54bf6ac833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:44.102913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677746-264a-445f-b07c-be70bd106950 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:44.121120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdab9c4-ed8f-4e0e-a444-8dae22f0eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:44.121904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab9c4-ed8f-4e0e-a444-8dae22f0eb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:44.122225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab9c4-ed8f-4e0e-a444-8dae22f0eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:44.122508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab9c4-ed8f-4e0e-a444-8dae22f0eb3b admin admin] PATH_INFO: `/v3/projects/3b385724eaa747a4b07980f9c932c650/users/79a88ec8dcff4452934182d42927a8c4/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:44.164875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdab9c4-ed8f-4e0e-a444-8dae22f0eb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b385724eaa747a4b07980f9c932c650, user_id=79a88ec8dcff4452934182d42927a8c4, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:44.171831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdab9c4-ed8f-4e0e-a444-8dae22f0eb3b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:44.179597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:44.205453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9c710e93-34bb-46cb-b5cc-ec54bf6ac833 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:44.208029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9c710e93-34bb-46cb-b5cc-ec54bf6ac833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:44.228534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 671/1347] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:44 2022] PUT /identity/v3/projects/3b385724eaa747a4b07980f9c932c650/users/79a88ec8dcff4452934182d42927a8c4/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:44.230604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768434-74f1-4c91-a63d-f9f731fb5bcc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:44.230604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768434-74f1-4c91-a63d-f9f731fb5bcc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:44.230867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768434-74f1-4c91-a63d-f9f731fb5bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:44.314159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0f768434-74f1-4c91-a63d-f9f731fb5bcc None None] MFA Rules not processed for user `79a88ec8dcff4452934182d42927a8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:44.315416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0f768434-74f1-4c91-a63d-f9f731fb5bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:44.427575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:44.470569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 677/1348] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Oct 23 20:05:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:44.491316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c710e93-34bb-46cb-b5cc-ec54bf6ac833 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:44.547143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c710e93-34bb-46cb-b5cc-ec54bf6ac833 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:44.555955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:44.556719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:44.557134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:44.557502 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:44.559536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 672/1349] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:44.565219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768434-74f1-4c91-a63d-f9f731fb5bcc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:44.757717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:44.759373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:44.762740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768434-74f1-4c91-a63d-f9f731fb5bcc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:44.784010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 678/1350] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:44.804575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:44.805384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:44.806186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:44.806628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:44.807422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:44.809485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:44.887542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 673/1351] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:44 2022] POST /identity/v3/projects => generated 385 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:05:44.892948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:44.908201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb714-a733-4be1-acbe-4c4bfa14bf13 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:45.039695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:45.044843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.045344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.047888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:45.049451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:45.055484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:45.138515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:45.150190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 679/1352] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:44 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:45.164396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9e90-6a04-4607-a0f3-93673ca7e3c6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:45.178968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:45.183452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.183966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.187553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:45.193000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:45.197773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:45.232947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 674/1353] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:45.238646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:45.259555 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea027f-efb1-4afc-b7aa-3ebb6f336db5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:45.270706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:45.276316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.278026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.279662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] PATH_INFO: `/v3/projects/6b4d536b32ab4e3bb5fb3ac16de3d606/users/109b7a3a5a5d4b10855a1ad6d6ce0c95/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:45.352822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d536b32ab4e3bb5fb3ac16de3d606, user_id=109b7a3a5a5d4b10855a1ad6d6ce0c95, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:45.363047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:45.406588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:45.413150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 680/1354] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:45 2022] PUT /identity/v3/projects/6b4d536b32ab4e3bb5fb3ac16de3d606/users/109b7a3a5a5d4b10855a1ad6d6ce0c95/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:45.425840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f41bf-9e38-4a6d-bbb5-7a9d7c9cc535 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:45.600813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354568-9d1d-4990-9623-7bf319331e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:45.601498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354568-9d1d-4990-9623-7bf319331e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.601936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354568-9d1d-4990-9623-7bf319331e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.602361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354568-9d1d-4990-9623-7bf319331e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:45.603283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354568-9d1d-4990-9623-7bf319331e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:45.605648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354568-9d1d-4990-9623-7bf319331e3a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:45.612503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:45.640073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:45.654169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 675/1355] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:45.662552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861911e7-b4e1-45ad-95f7-07bbbb26a100 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:45.671449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78399-edee-4b86-844b-8e81a2c00711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:45.672667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78399-edee-4b86-844b-8e81a2c00711 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.673449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78399-edee-4b86-844b-8e81a2c00711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.674015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78399-edee-4b86-844b-8e81a2c00711 admin admin] PATH_INFO: `/v3/projects/6b4d536b32ab4e3bb5fb3ac16de3d606/users/109b7a3a5a5d4b10855a1ad6d6ce0c95/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:45.676677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a78399-edee-4b86-844b-8e81a2c00711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d536b32ab4e3bb5fb3ac16de3d606, user_id=109b7a3a5a5d4b10855a1ad6d6ce0c95, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:45.703476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a78399-edee-4b86-844b-8e81a2c00711 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:45.749399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 681/1356] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:45 2022] PUT /identity/v3/projects/6b4d536b32ab4e3bb5fb3ac16de3d606/users/109b7a3a5a5d4b10855a1ad6d6ce0c95/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:45.753004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.754436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.754899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:45.855987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] MFA Rules not processed for user `109b7a3a5a5d4b10855a1ad6d6ce0c95`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:45.865170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:45.926576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef385-e9e9-4d74-98ba-dad6569632be None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.926882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef385-e9e9-4d74-98ba-dad6569632be None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.927355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef385-e9e9-4d74-98ba-dad6569632be None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:45.929138 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 682/1357] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:05:45.983527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe5a4a-a975-401f-82de-b12f5cd5bd1e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:45.984647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe5a4a-a975-401f-82de-b12f5cd5bd1e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:45.985038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe5a4a-a975-401f-82de-b12f5cd5bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:46.027665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-26fe5a4a-a975-401f-82de-b12f5cd5bd1e None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:46.029038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-26fe5a4a-a975-401f-82de-b12f5cd5bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:46.150510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 676/1358] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:46.166056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:46.166880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:46.168304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:46.231450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 683/1359] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:05:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:46.253149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe5a4a-a975-401f-82de-b12f5cd5bd1e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:46.304445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe5a4a-a975-401f-82de-b12f5cd5bd1e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:46.315513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:46.317234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:46.318450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:46.319118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:46.326224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cda35-bf2f-4e77-a0b7-3d32d5a44da8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:46.334236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:46.336262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:46.337037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:46.337293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:46.337425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:46.337599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:46.360736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:46.364811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:46.370717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 684/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:46.371751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:46.378263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:46.396491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 677/1361] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:46.550326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:46.565795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3fadf-8db3-4b17-a35f-fb962b8155df service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:46.577983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:46.582677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:46.583916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0641a-486b-441c-86e2-301fc2d62dfc service placement] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:46.584841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:46.584841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] PATH_INFO: `/v3/users/79a88ec8dcff4452934182d42927a8c4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:46.586842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a88ec8dcff4452934182d42927a8c4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:46.592057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:46.598033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:46.598999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:46.616331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:46.619637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] PATH_INFO: `/v3/users/1ff5294caf23474f8d5b12906fd87fdf` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:46.621476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff5294caf23474f8d5b12906fd87fdf)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:46.625650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:46.750928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a88ec8dcff4452934182d42927a8c4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.787617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a88ec8dcff4452934182d42927a8c4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.811061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a88ec8dcff4452934182d42927a8c4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.814853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a88ec8dcff4452934182d42927a8c4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.815803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff5294caf23474f8d5b12906fd87fdf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.843945 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:46.847255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc0fc71b-94c6-4528-a240-6efce0a9d15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a88ec8dcff4452934182d42927a8c4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.852788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff5294caf23474f8d5b12906fd87fdf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.854977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff5294caf23474f8d5b12906fd87fdf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.855660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff5294caf23474f8d5b12906fd87fdf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.869513 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 678/1362] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:46 2022] DELETE /identity/v3/users/79a88ec8dcff4452934182d42927a8c4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:05:46.871961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:46.872424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:46.872844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:46.878613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff5294caf23474f8d5b12906fd87fdf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:46.917640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 685/1363] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:46 2022] DELETE /identity/v3/users/1ff5294caf23474f8d5b12906fd87fdf => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:46.922338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:46.923901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:47.071408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 679/1364] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:47.086301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:47.087602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:47.225003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:47.238875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760bad7-02c1-4d9a-9b5d-15b459e9b1e2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:47.250276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:47.251073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:47.251526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:47.254216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:47.278803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:47.285524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:47.316270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 686/1365] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:48.883942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:48.887357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:48.908272 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d6525-83bb-42b9-949e-d253cdefeff0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:48.914752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:48.916018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:48.916438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:48.916850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] PATH_INFO: `/v3/projects/6725b2f8a4f44b3cb9e1e5f5e3bf7bdf` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:48.918496 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6725b2f8a4f44b3cb9e1e5f5e3bf7bdf)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:48.921931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:49.039419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6725b2f8a4f44b3cb9e1e5f5e3bf7bdf', 'request_id': 'req-ee8bba28-2aa5-4399-8e18-a75a00886bf3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.049645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6725b2f8a4f44b3cb9e1e5f5e3bf7bdf', 'request_id': 'req-ee8bba28-2aa5-4399-8e18-a75a00886bf3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.065208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6725b2f8a4f44b3cb9e1e5f5e3bf7bdf', 'request_id': 'req-ee8bba28-2aa5-4399-8e18-a75a00886bf3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.113075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] The token cache is being invalidate because project 6725b2f8a4f44b3cb9e1e5f5e3bf7bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:05:49.113602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.116383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ee8bba28-2aa5-4399-8e18-a75a00886bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.128888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 680/1366] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:05:48 2022] DELETE /identity/v3/projects/6725b2f8a4f44b3cb9e1e5f5e3bf7bdf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:49.132823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:49.152880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ad8ae-46a0-4d35-90c3-f95fb81f63ad service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:49.298177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:49.298768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:49.299054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:49.299332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] PATH_INFO: `/v3/users/ce3a9bbff04a4d3e99343b95bb51a681` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:49.304279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3a9bbff04a4d3e99343b95bb51a681)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:49.312672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:49.426977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3a9bbff04a4d3e99343b95bb51a681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.439472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d93d0-2007-46ae-9d90-a3a8bac51c39 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:49.440258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d93d0-2007-46ae-9d90-a3a8bac51c39 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:49.440646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d93d0-2007-46ae-9d90-a3a8bac51c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:49.474282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3a9bbff04a4d3e99343b95bb51a681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.474282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3a9bbff04a4d3e99343b95bb51a681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.474282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3a9bbff04a4d3e99343b95bb51a681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.489417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-657708cf-8bc9-473e-9b81-0f79865613d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3a9bbff04a4d3e99343b95bb51a681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:49.519806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1f0d93d0-2007-46ae-9d90-a3a8bac51c39 None None] MFA Rules not processed for user `2c77f0bef97f4a3681f6f3d435efd9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:49.520291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 687/1367] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:49 2022] DELETE /identity/v3/users/ce3a9bbff04a4d3e99343b95bb51a681 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:49.521364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1f0d93d0-2007-46ae-9d90-a3a8bac51c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:49.684995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 681/1368] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:49.743082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122e093-6262-4d1a-bc6e-98d460557d4f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:49.743082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122e093-6262-4d1a-bc6e-98d460557d4f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:49.743082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122e093-6262-4d1a-bc6e-98d460557d4f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:49.744803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 688/1369] 10.222.0.18 () {54 vars in 961 bytes} [Sun Oct 23 20:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:05:49.770569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80327e7-e553-4f51-9dc5-261c1b096d91 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:49.771390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80327e7-e553-4f51-9dc5-261c1b096d91 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:49.771814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80327e7-e553-4f51-9dc5-261c1b096d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:49.841955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d80327e7-e553-4f51-9dc5-261c1b096d91 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:49.843833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d80327e7-e553-4f51-9dc5-261c1b096d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:49.849308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:50.008582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 682/1370] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Oct 23 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:50.016526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122e093-6262-4d1a-bc6e-98d460557d4f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:50.066655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf6926-0b3d-497f-91b9-081de1833cec None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.067324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf6926-0b3d-497f-91b9-081de1833cec None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.067678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf6926-0b3d-497f-91b9-081de1833cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:50.086851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122e093-6262-4d1a-bc6e-98d460557d4f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:50.116100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:50.117192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.117670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.118263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:50.122135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8fcf6926-0b3d-497f-91b9-081de1833cec None None] MFA Rules not processed for user `5c7a939da3c34d418d768cb7bdf9920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:50.125078 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8fcf6926-0b3d-497f-91b9-081de1833cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:50.137744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:50.141259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:50.171283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 689/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:50.172153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:50.178316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:50.268465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 683/1372] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:50.394011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:50.402305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed35a-594d-4ece-b5f3-8b177c9bdd55 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.403308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed35a-594d-4ece-b5f3-8b177c9bdd55 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.403880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed35a-594d-4ece-b5f3-8b177c9bdd55 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:50.407662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 684/1373] 10.222.0.18 () {54 vars in 912 bytes} [Sun Oct 23 20:05:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 20:05:50.416856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.417494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.418004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:50.423980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93b4d0-2c4b-4f02-9823-ba1db4ebf7e6 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:50.437537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:50.438833 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.439273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.439610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] PATH_INFO: `/v3/projects/3b385724eaa747a4b07980f9c932c650` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:50.442599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b385724eaa747a4b07980f9c932c650)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:50.449915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:50.454145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:50.456259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:50.485399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 685/1374] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:50.497681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:50.500066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:50.560906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b385724eaa747a4b07980f9c932c650', 'request_id': 'req-4d082f29-ac14-4198-9203-6ff07fce96fd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:50.579909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b385724eaa747a4b07980f9c932c650', 'request_id': 'req-4d082f29-ac14-4198-9203-6ff07fce96fd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:50.629970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b385724eaa747a4b07980f9c932c650', 'request_id': 'req-4d082f29-ac14-4198-9203-6ff07fce96fd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:50.637812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa7d7-8567-4bd5-83b3-343e2efce119 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:50.660476 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] The token cache is being invalidate because project 3b385724eaa747a4b07980f9c932c650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:05:50.663496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:50.664441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:50.667532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 690/1375] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:05:50 2022] DELETE /identity/v3/projects/3b385724eaa747a4b07980f9c932c650 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:50.672175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:50.683654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:50.706500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:50.757560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f6d6-1826-4fef-a0c0-e4ae2403ae26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:50.759331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f6d6-1826-4fef-a0c0-e4ae2403ae26 service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.759604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f6d6-1826-4fef-a0c0-e4ae2403ae26 service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.759876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f6d6-1826-4fef-a0c0-e4ae2403ae26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:50.765271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9b64f6d6-1826-4fef-a0c0-e4ae2403ae26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:50.885479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082f29-ac14-4198-9203-6ff07fce96fd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:50.891922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:50.892849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.893649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.894104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] PATH_INFO: `/v3/users/109b7a3a5a5d4b10855a1ad6d6ce0c95` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:50.895489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=109b7a3a5a5d4b10855a1ad6d6ce0c95)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:50.897686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:50.954990 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64f6d6-1826-4fef-a0c0-e4ae2403ae26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:50.956701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64f6d6-1826-4fef-a0c0-e4ae2403ae26 service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:50.980723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 686/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:05:50.982403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:50.982699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:50.983267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:51.003531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109b7a3a5a5d4b10855a1ad6d6ce0c95'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.041809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109b7a3a5a5d4b10855a1ad6d6ce0c95'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.041809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109b7a3a5a5d4b10855a1ad6d6ce0c95'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.045264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109b7a3a5a5d4b10855a1ad6d6ce0c95'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.059936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109b7a3a5a5d4b10855a1ad6d6ce0c95'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.091862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 691/1377] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:50 2022] DELETE /identity/v3/users/109b7a3a5a5d4b10855a1ad6d6ce0c95 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:51.094019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:51.097811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] MFA Rules not processed for user `2e4843b52aa8440a8ec485d103932ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:51.099893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:51.101901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:51.119647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:51.309434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c244ab9-8faa-4e84-b101-804bf740cfcd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:51.319455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 687/1378] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:51.334152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:51.334728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:51.334860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:51.335089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:51.335369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] PATH_INFO: `/v3/projects/d9af3d65ba0146dfb922967ea9c0d83f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:51.338342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:51.338820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9af3d65ba0146dfb922967ea9c0d83f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:51.340821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:51.470514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9af3d65ba0146dfb922967ea9c0d83f', 'request_id': 'req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.485396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9af3d65ba0146dfb922967ea9c0d83f', 'request_id': 'req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.508436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9af3d65ba0146dfb922967ea9c0d83f', 'request_id': 'req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.535404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] The token cache is being invalidate because project d9af3d65ba0146dfb922967ea9c0d83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:05:51.535404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.541199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcc7790c-2e8f-4769-a6ce-d8f4cbda7a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:51.546573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 692/1379] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:05:51 2022] DELETE /identity/v3/projects/d9af3d65ba0146dfb922967ea9c0d83f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:51.552196 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d43f-effb-4c59-b393-21032def6a83 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:51.552494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d43f-effb-4c59-b393-21032def6a83 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:51.553289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836d43f-effb-4c59-b393-21032def6a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:51.603472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:51.609399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b836d43f-effb-4c59-b393-21032def6a83 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:51.613751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b836d43f-effb-4c59-b393-21032def6a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:51.621961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945668c-4ca7-473a-bcfe-1d4f7c395b88 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:51.785757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 693/1380] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:51.788383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6908-8d2d-4902-a54e-654d1e295363 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:51.789232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6908-8d2d-4902-a54e-654d1e295363 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:51.789533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6908-8d2d-4902-a54e-654d1e295363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:51.848520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-38fe6908-8d2d-4902-a54e-654d1e295363 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:51.849771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-38fe6908-8d2d-4902-a54e-654d1e295363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:51.886998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 694/1381] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:51.889971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe6908-8d2d-4902-a54e-654d1e295363 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:51.894690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:51.895981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:51.896265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:51.896541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:51.902318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:51.933075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe6908-8d2d-4902-a54e-654d1e295363 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:51.952398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:51.953211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:51.953500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:51.953780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:51.954478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:51.954787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:51.966448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:52.019505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 695/1382] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:52.023910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:52.036894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7cf98-24af-4706-b256-2f24ac488552 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:52.043051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:52.043670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.043955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.044233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.044884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:52.047860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:52.071408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:52.074674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:52.085169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:52.113509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 696/1383] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:52 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:52.114617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 688/1384] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:52.115065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:52.278854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40886dd-f805-47a2-a41b-d7ecd650752e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:52.292126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:52.292767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.293053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.293333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.294045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:52.299938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:52.356976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 697/1385] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:52 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:52.361005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:52.383656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643d6a3-9693-4dfa-8a73-c1c98387be56 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:52.428988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed96181-e94d-40cc-aee2-bac13770e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:52.429910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96181-e94d-40cc-aee2-bac13770e3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.430417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96181-e94d-40cc-aee2-bac13770e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.430865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96181-e94d-40cc-aee2-bac13770e3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.431720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed96181-e94d-40cc-aee2-bac13770e3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:52.434912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed96181-e94d-40cc-aee2-bac13770e3ad admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:52.488438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 689/1386] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:52.493066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:52.511229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388b833-b62a-4ac6-844d-159dbfec7158 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:52.513941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50862fa-816b-4595-87ef-0b2fae9341b9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.515274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50862fa-816b-4595-87ef-0b2fae9341b9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.515771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50862fa-816b-4595-87ef-0b2fae9341b9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.518374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 690/1387] 10.222.0.18 () {54 vars in 912 bytes} [Sun Oct 23 20:05:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:05:52.524445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd7576-b6d2-4551-8b6e-c21e522fd441 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.525281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd7576-b6d2-4551-8b6e-c21e522fd441 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.525750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd7576-b6d2-4551-8b6e-c21e522fd441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.526780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:52.527407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.527690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.527971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.528625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:52.531235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:52.554800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 698/1388] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:52.559712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:52.579510 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99e36a-32d5-4b85-94ae-d6436357554f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:52.595081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8ac4-3ca3-4f8d-8269-c6306530f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:52.599894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8ac4-3ca3-4f8d-8269-c6306530f3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.601864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8ac4-3ca3-4f8d-8269-c6306530f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.602392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8ac4-3ca3-4f8d-8269-c6306530f3e6 admin admin] PATH_INFO: `/v3/projects/017676ca8d074a85b1f6835a593cd472/users/891bc2148a6b42dcbcef2209f8761184/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.631183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3afd7576-b6d2-4551-8b6e-c21e522fd441 None None] MFA Rules not processed for user `3f748dc73ef7444d9382a0680e027c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:52.632520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3afd7576-b6d2-4551-8b6e-c21e522fd441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:52.643827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8ac4-3ca3-4f8d-8269-c6306530f3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017676ca8d074a85b1f6835a593cd472, user_id=891bc2148a6b42dcbcef2209f8761184, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:52.647936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8ac4-3ca3-4f8d-8269-c6306530f3e6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:52.681596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 699/1389] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:52 2022] PUT /identity/v3/projects/017676ca8d074a85b1f6835a593cd472/users/891bc2148a6b42dcbcef2209f8761184/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:52.694602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.694970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.695324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:52.782903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] MFA Rules not processed for user `891bc2148a6b42dcbcef2209f8761184`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:52.785030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:52.886906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 691/1390] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:05:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:52.891562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b1e8-6b2c-4066-aee6-639abe2d91f9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:52.891889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b1e8-6b2c-4066-aee6-639abe2d91f9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:52.892507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b1e8-6b2c-4066-aee6-639abe2d91f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:53.007483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c823b1e8-6b2c-4066-aee6-639abe2d91f9 None None] MFA Rules not processed for user `66585fd9c7304bc08c419a49ac3476f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:53.009492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c823b1e8-6b2c-4066-aee6-639abe2d91f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:53.068204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:53.083700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 700/1391] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:53.087341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:53.093203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:53.224953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:53.292617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d4c0e-9269-4f4f-9a73-61bb9d81b0a5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:53.301459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 692/1392] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:53.315156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff808b2-55c0-4190-b39d-91f8ce37a7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:53.316325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff808b2-55c0-4190-b39d-91f8ce37a7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:53.317077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff808b2-55c0-4190-b39d-91f8ce37a7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:53.317203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff808b2-55c0-4190-b39d-91f8ce37a7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:53.317626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b1e8-6b2c-4066-aee6-639abe2d91f9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:53.337872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff808b2-55c0-4190-b39d-91f8ce37a7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:53.339624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff808b2-55c0-4190-b39d-91f8ce37a7a4 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:53.371018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 701/1393] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:53.387713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:53.389926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:53.393441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:53.445568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] MFA Rules not processed for user `66585fd9c7304bc08c419a49ac3476f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:53.446864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:53.480820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 702/1394] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:53.489686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b1e8-6b2c-4066-aee6-639abe2d91f9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:53.493593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:53.495854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:53.497201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:53.499578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:53.500044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:53.500494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:53.501334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:53.504736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:53.576451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 693/1395] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:53 2022] POST /identity/v3/projects => generated 381 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:53.580205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:53.711251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d07562-fb4a-40c5-99aa-4f6613491162 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:53.759939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212a40-f6db-4bcc-92d5-bd12643701f1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:53.773919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:53.774582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:53.774865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:53.775139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:53.775793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:53.779076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:53.833827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 694/1396] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:53 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:05:53.834784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:53.841962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:53.878469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:53.880250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:53.880588 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:53.880891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:53.885185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e0991-5327-4fa7-a92c-ee1859affda9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:53.900831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:53.903889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:53.904212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:53.908605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] PATH_INFO: `/v3/projects/6b4d536b32ab4e3bb5fb3ac16de3d606` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:53.914757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4d536b32ab4e3bb5fb3ac16de3d606)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:53.924278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:54.043816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:54.112126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4d536b32ab4e3bb5fb3ac16de3d606', 'request_id': 'req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:54.122239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:54.133463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:54.148162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4d536b32ab4e3bb5fb3ac16de3d606', 'request_id': 'req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:54.170655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 703/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:54.174281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4d536b32ab4e3bb5fb3ac16de3d606', 'request_id': 'req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:54.181591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:54.228372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] The token cache is being invalidate because project 6b4d536b32ab4e3bb5fb3ac16de3d606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:05:54.228895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:54.231598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66518fa-5d08-41a9-8ded-211211efc8e5 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:54.235283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5fd97a0e-a882-4de2-802a-48cdc9ce47ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:54.244136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 695/1398] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:05:53 2022] DELETE /identity/v3/projects/6b4d536b32ab4e3bb5fb3ac16de3d606 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:54.254782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d42e0b-0a38-4324-bac9-eca21a8e806c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:54.255491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d42e0b-0a38-4324-bac9-eca21a8e806c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:54.257480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d42e0b-0a38-4324-bac9-eca21a8e806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:54.266653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:54.358919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-48d42e0b-0a38-4324-bac9-eca21a8e806c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:54.359933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-48d42e0b-0a38-4324-bac9-eca21a8e806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:54.413208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98160a-2a67-49bf-a071-2cf9fc165c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:54.414312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98160a-2a67-49bf-a071-2cf9fc165c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:54.414609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98160a-2a67-49bf-a071-2cf9fc165c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:54.414864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98160a-2a67-49bf-a071-2cf9fc165c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:54.415510 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98160a-2a67-49bf-a071-2cf9fc165c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:54.417301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98160a-2a67-49bf-a071-2cf9fc165c5e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:54.451304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 704/1399] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:54.451304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df373-e514-48e4-84e0-10790d619edf None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:54.452855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df373-e514-48e4-84e0-10790d619edf None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:54.453151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df373-e514-48e4-84e0-10790d619edf None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:54.457099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 705/1400] 10.222.0.18 () {54 vars in 912 bytes} [Sun Oct 23 20:05:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:05:54.463130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983df373-e514-48e4-84e0-10790d619edf None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:54.469373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-983df373-e514-48e4-84e0-10790d619edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:54.511037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983df373-e514-48e4-84e0-10790d619edf None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:54.524009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572c089-edfe-4abd-8b97-446076f5856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:54.524628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c089-edfe-4abd-8b97-446076f5856c admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:54.524906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c089-edfe-4abd-8b97-446076f5856c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:54.525183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c089-edfe-4abd-8b97-446076f5856c admin admin] PATH_INFO: `/v3/projects/e1a588bce0134452987200b00737b3a8/users/11dd4ec73203422095cdb2445d9d2d96/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:54.529473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 696/1401] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:54.533369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9c2e-02c7-4317-bf64-f17a5a455d81 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:54.533683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9c2e-02c7-4317-bf64-f17a5a455d81 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:54.533963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e9c2e-02c7-4317-bf64-f17a5a455d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:54.564487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572c089-edfe-4abd-8b97-446076f5856c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a588bce0134452987200b00737b3a8, user_id=11dd4ec73203422095cdb2445d9d2d96, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:54.572843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572c089-edfe-4abd-8b97-446076f5856c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:54.621080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-731e9c2e-02c7-4317-bf64-f17a5a455d81 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:54.622445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-731e9c2e-02c7-4317-bf64-f17a5a455d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:54.645109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 706/1402] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:54 2022] PUT /identity/v3/projects/e1a588bce0134452987200b00737b3a8/users/11dd4ec73203422095cdb2445d9d2d96/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:54.646952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d003a-f3fe-428a-b169-91362f653831 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:54.647247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d003a-f3fe-428a-b169-91362f653831 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:54.647528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d003a-f3fe-428a-b169-91362f653831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:54.740038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0a1d003a-f3fe-428a-b169-91362f653831 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:54.744910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0a1d003a-f3fe-428a-b169-91362f653831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:54.864863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 697/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:05:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:54.865861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9c2e-02c7-4317-bf64-f17a5a455d81 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:54.922829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 707/1404] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:54.928379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:54.928722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:54.929197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:54.946180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:54.962347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] MFA Rules not processed for user `2c77f0bef97f4a3681f6f3d435efd9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:54.964307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.018130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e9c2e-02c7-4317-bf64-f17a5a455d81 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:55.028211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:55.029111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:55.029533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:55.030366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:55.031696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:55.033683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:55.054498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 698/1405] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:55.055728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:55.072129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.103347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 708/1406] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:55.106062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:55.110188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.145761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591409-42ea-4e4f-bdea-7e87e30c4606 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:55.159725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:55.160629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:55.164106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:55.164531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] PATH_INFO: `/v3/users/6a5f0f3e841e444582463b9a44b79a34` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:55.168311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5f0f3e841e444582463b9a44b79a34)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:55.172083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:55.231863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:55.253882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb8919-2794-4cc9-b3a0-193ccb31a9bd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:55.278477 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:55.280700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:55.281361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:55.282066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:55.287479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.290941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5f0f3e841e444582463b9a44b79a34'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:55.319099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:55.323783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:55.328868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5f0f3e841e444582463b9a44b79a34'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:55.329895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5f0f3e841e444582463b9a44b79a34'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:55.330700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5f0f3e841e444582463b9a44b79a34'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:55.353569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5f0f3e841e444582463b9a44b79a34'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:55.354714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 699/1407] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:55.356406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:55.359664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.380135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 709/1408] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:55 2022] DELETE /identity/v3/users/6a5f0f3e841e444582463b9a44b79a34 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:55.380135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:55.382098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.523007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de8974-5e56-4867-ae62-6ad47899e65b service placement] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:55.576383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c71b-287b-458f-92ba-aacbb33311d7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:55.597293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:55.597977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:55.598322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:55.598866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:55.602122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:05:55.602122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:55.602122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:55.659449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:55.660088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:55.660373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:55.660649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:55.666693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 710/1409] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:05:55.670999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.672862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:55.681693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.697826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80fc99-497b-406b-9fbe-1e5cd17d159a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:55.704365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9186d-ef68-4768-8417-cd8c8d9c7bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:55.705040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9186d-ef68-4768-8417-cd8c8d9c7bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:55.705319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9186d-ef68-4768-8417-cd8c8d9c7bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:55.705592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9186d-ef68-4768-8417-cd8c8d9c7bbb admin admin] PATH_INFO: `/v3/projects/e1a588bce0134452987200b00737b3a8/users/11dd4ec73203422095cdb2445d9d2d96/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:55.713846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9186d-ef68-4768-8417-cd8c8d9c7bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a588bce0134452987200b00737b3a8, user_id=11dd4ec73203422095cdb2445d9d2d96, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:55.716904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9186d-ef68-4768-8417-cd8c8d9c7bbb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:55.737269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 711/1410] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:55 2022] PUT /identity/v3/projects/e1a588bce0134452987200b00737b3a8/users/11dd4ec73203422095cdb2445d9d2d96/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:55.738685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975fea-c319-41f5-83ed-73aec2d0d393 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:55.738944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975fea-c319-41f5-83ed-73aec2d0d393 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:55.739216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975fea-c319-41f5-83ed-73aec2d0d393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:55.776543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:55.803689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6a975fea-c319-41f5-83ed-73aec2d0d393 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:55.805314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6a975fea-c319-41f5-83ed-73aec2d0d393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:55.835328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:55.836906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:55.868476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 700/1411] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:55.869356 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:55.890567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe511-a160-4b71-aee0-3f8e0d9965ae service glance] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.044795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.045608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.046055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.046372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.047129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:56.049509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:56.052979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 712/1412] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:56.054468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.054756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.055030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.102995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] MFA Rules not processed for user `11dd4ec73203422095cdb2445d9d2d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:56.104321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:56.108369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 701/1413] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:55 2022] POST /identity/v3/projects => generated 367 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:56.112181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:56.130780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:56.287113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 713/1414] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:56.288022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:56.289704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:56.292974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f05d4c-2edf-40c5-98fb-9876a1a02594 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.305506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.306471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.306861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.307670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.314933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:56.316920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:56.397587 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 702/1415] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:56 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:56.400563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:56.409767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:56.491315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2e0d4-7535-4de9-970a-a24af577880d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.508023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.508657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.508940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.509217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.535640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:56.537274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:56.569075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 714/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:56.569965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:56.595368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e34ad3-68ff-41c6-a750-29f360a0052e service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.613449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.623358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.623862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.625362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.626181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:56.627773 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:56.630695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:56.650996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592840af-f60f-4db5-90d8-ccd2eee97027 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.657634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.660256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.660770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.661992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.690876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:56.692545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:56.693420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 715/1417] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:56.703634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:56.715822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 703/1418] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:56.754286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6062-5f80-4a8c-82c5-b00cf16ef6bc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.794496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.796969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.797178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.797441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.798115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:56.799826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:56.855986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:56.856955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 716/1419] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:56.893336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab75d-630a-4238-a890-4b403063f29f service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.911675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:56.912862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe0893-08bc-4785-8892-d015532d2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.913807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe0893-08bc-4785-8892-d015532d2101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.915961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe0893-08bc-4785-8892-d015532d2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.917077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe0893-08bc-4785-8892-d015532d2101 admin admin] PATH_INFO: `/v3/projects/2a66b07f11054a60a094c435abc7648e/users/499b76ba168140c1be2b670b1723030e/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.923062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c659dc-eb41-49ce-901b-148f025afa21 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:56.936841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae6ccb-83db-4708-9e41-62f10081aad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:56.937568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6ccb-83db-4708-9e41-62f10081aad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.937834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6ccb-83db-4708-9e41-62f10081aad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.939460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6ccb-83db-4708-9e41-62f10081aad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:56.943706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7cae6ccb-83db-4708-9e41-62f10081aad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:56.955743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe0893-08bc-4785-8892-d015532d2101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a66b07f11054a60a094c435abc7648e, user_id=499b76ba168140c1be2b670b1723030e, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:56.959714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe0893-08bc-4785-8892-d015532d2101 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:56.988139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 704/1420] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:56 2022] PUT /identity/v3/projects/2a66b07f11054a60a094c435abc7648e/users/499b76ba168140c1be2b670b1723030e/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:56.989364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17745-544d-4633-bdc3-b70f0e83bc9d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:56.991016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17745-544d-4633-bdc3-b70f0e83bc9d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:56.991325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17745-544d-4633-bdc3-b70f0e83bc9d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.000778 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 705/1421] 10.222.0.18 () {54 vars in 912 bytes} [Sun Oct 23 20:05:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:05:57.004345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c10a3-2827-4f4c-96a5-9298b7e37a8b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.004641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c10a3-2827-4f4c-96a5-9298b7e37a8b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.004919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c10a3-2827-4f4c-96a5-9298b7e37a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.066233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae6ccb-83db-4708-9e41-62f10081aad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:57.067559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae6ccb-83db-4708-9e41-62f10081aad0 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:57.072219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b47c10a3-2827-4f4c-96a5-9298b7e37a8b None None] MFA Rules not processed for user `499b76ba168140c1be2b670b1723030e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:57.073721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b47c10a3-2827-4f4c-96a5-9298b7e37a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:57.090148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 717/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:05:57.091505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.091795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.092075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.135668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] MFA Rules not processed for user `3f748dc73ef7444d9382a0680e027c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:57.136896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:57.188716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:57.232011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 706/1423] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:57.234195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c10a3-2827-4f4c-96a5-9298b7e37a8b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:57.283873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 718/1424] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:05:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:57.285046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:57.287086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:57.307402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ffc0-0d94-45ff-b6c8-59148f9c7d0f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:57.315249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:57.316237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.316532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.318420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.331598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:57.335234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:57.416861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 719/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:05:57.460025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c10a3-2827-4f4c-96a5-9298b7e37a8b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:57.493022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840e92-3bf6-4637-96f9-7b04d840493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:57.493889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840e92-3bf6-4637-96f9-7b04d840493e admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.495252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840e92-3bf6-4637-96f9-7b04d840493e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.495716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840e92-3bf6-4637-96f9-7b04d840493e admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.496496 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840e92-3bf6-4637-96f9-7b04d840493e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:57.500498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840e92-3bf6-4637-96f9-7b04d840493e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:57.549475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 707/1426] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:05:57 2022] POST /identity/v3/projects => generated 367 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:57.550737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:57.571203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bbcea-01eb-418e-88cc-369f3f601204 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:57.646994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3992f8-26ce-48f5-b64d-940a92aaa547 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.647286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3992f8-26ce-48f5-b64d-940a92aaa547 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.647579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3992f8-26ce-48f5-b64d-940a92aaa547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.699482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:57.701237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9a3992f8-26ce-48f5-b64d-940a92aaa547 None None] MFA Rules not processed for user `2e4843b52aa8440a8ec485d103932ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:57.703461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.703875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.707521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.707521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:57.707950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9a3992f8-26ce-48f5-b64d-940a92aaa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:57.711756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:57.770300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 720/1427] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:05:57 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:05:57.776195 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:57.787921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:57.810113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e6a32-b05f-41d0-af53-42abf511a25c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:57.820056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:57.820877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.821192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.821494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.822295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:57.824119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:57.831606 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 708/1428] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:05:57.853239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3992f8-26ce-48f5-b64d-940a92aaa547 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:57.854496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 721/1429] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:57.872947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3992f8-26ce-48f5-b64d-940a92aaa547 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:57.887667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:57.889806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:57.890341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:57.891374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] PATH_INFO: `/v3/projects/23fa52b988da4dc4963f67264e1104fc/users/b18755eda7a745a7833d2c8a638ec251/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:57.944316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fa52b988da4dc4963f67264e1104fc, user_id=b18755eda7a745a7833d2c8a638ec251, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:57.958607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:57.998247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 709/1430] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:57 2022] PUT /identity/v3/projects/23fa52b988da4dc4963f67264e1104fc/users/b18755eda7a745a7833d2c8a638ec251/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:58.003602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:58.019157 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1162f6-1b86-403b-b87f-af8ad6a6eeea admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:58.178268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:58.180476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:58.232324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:58.233736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:58.234047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:58.234349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:58.235010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:58.237320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:58.258465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 722/1431] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:05:58.259552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:58.283507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76472836-ea15-493f-b50e-19a4b4bcc635 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:58.313535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a041f9b-d416-4894-a1cc-cfb776a7602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:58.314249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a041f9b-d416-4894-a1cc-cfb776a7602c admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:58.314736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a041f9b-d416-4894-a1cc-cfb776a7602c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:58.315038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a041f9b-d416-4894-a1cc-cfb776a7602c admin admin] PATH_INFO: `/v3/projects/23fa52b988da4dc4963f67264e1104fc/users/b18755eda7a745a7833d2c8a638ec251/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:58.321577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a041f9b-d416-4894-a1cc-cfb776a7602c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fa52b988da4dc4963f67264e1104fc, user_id=b18755eda7a745a7833d2c8a638ec251, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:58.333269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a041f9b-d416-4894-a1cc-cfb776a7602c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:58.339664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c3bb7-4dcc-4c2b-811c-cc7d3a248e66 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:58.346866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:58.348072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:58.348880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:58.363039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] PATH_INFO: `/v3/projects/f5083dd0dcf0410f9d84395958461fb4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:58.367182 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5083dd0dcf0410f9d84395958461fb4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:58.370548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:58.373212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 723/1432] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:05:58 2022] PUT /identity/v3/projects/23fa52b988da4dc4963f67264e1104fc/users/b18755eda7a745a7833d2c8a638ec251/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:58.385403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:58.385889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:58.386353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:58.454459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] MFA Rules not processed for user `b18755eda7a745a7833d2c8a638ec251`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:05:58.455727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:58.491791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:58.583674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5083dd0dcf0410f9d84395958461fb4', 'request_id': 'req-b6e9336a-80bb-44cb-ae25-1964f3d73289'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:58.598883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5083dd0dcf0410f9d84395958461fb4', 'request_id': 'req-b6e9336a-80bb-44cb-ae25-1964f3d73289'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:58.616622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5083dd0dcf0410f9d84395958461fb4', 'request_id': 'req-b6e9336a-80bb-44cb-ae25-1964f3d73289'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:58.627367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 724/1433] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:05:58.642548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] The token cache is being invalidate because project f5083dd0dcf0410f9d84395958461fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:05:58.642861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:58.644902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:58.652244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 710/1434] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:05:58 2022] DELETE /identity/v3/projects/f5083dd0dcf0410f9d84395958461fb4 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:58.654122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:58.660148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:58.665378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:58.669041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:58.821725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:05:58.855719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478ad62-5ca1-4d10-83aa-a69be36dbddf None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:58.872365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9336a-80bb-44cb-ae25-1964f3d73289 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:05:58.897047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:58.898057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:58.898347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:58.900626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] PATH_INFO: `/v3/users/7de71416d6d149fd93576f2e851e8295` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:58.903149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de71416d6d149fd93576f2e851e8295)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:58.907436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:59.016027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de71416d6d149fd93576f2e851e8295'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:59.046906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de71416d6d149fd93576f2e851e8295'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:59.059660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccd3d1-e3de-4d03-815d-207906a6a31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:05:59.063228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccd3d1-e3de-4d03-815d-207906a6a31d service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:59.063599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccd3d1-e3de-4d03-815d-207906a6a31d service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:59.063942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccd3d1-e3de-4d03-815d-207906a6a31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:59.069021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de71416d6d149fd93576f2e851e8295'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:59.069850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de71416d6d149fd93576f2e851e8295'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:59.070074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-95ccd3d1-e3de-4d03-815d-207906a6a31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:59.127973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de71416d6d149fd93576f2e851e8295'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:05:59.154165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 711/1435] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:05:58 2022] DELETE /identity/v3/users/7de71416d6d149fd93576f2e851e8295 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:05:59.304059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccd3d1-e3de-4d03-815d-207906a6a31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:05:59.308320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccd3d1-e3de-4d03-815d-207906a6a31d service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:05:59.369513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 725/1436] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:05:59.830392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:05:59.832059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:05:59.867455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:05:59.867983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:05:59.868068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:05:59.944967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:00.009844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:00.011729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:00.049714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b11d-039f-4541-bfed-539ebbe6b82e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:00.061872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:00.062657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:00.063061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:00.063400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:00.072147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:00.278045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 726/1437] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:05:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:00.296795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:00.319528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:00.367914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 712/1438] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:05:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:00.563355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:00.565085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:00.642054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:00.653419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:00.830494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:00.923962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b024626-3ad8-49a9-9f06-57813dba3179 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:00.944592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be06020-594f-476b-a121-358a945b846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:00.945408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06020-594f-476b-a121-358a945b846d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:00.945845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06020-594f-476b-a121-358a945b846d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:00.946291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be06020-594f-476b-a121-358a945b846d admin admin] PATH_INFO: `/v3/projects/8d2ada08b7b74035bd2e183aaa70b9d2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:00.952827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06020-594f-476b-a121-358a945b846d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2ada08b7b74035bd2e183aaa70b9d2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:00.966846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be06020-594f-476b-a121-358a945b846d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:01.103635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5786e-ebbe-4399-9f55-7f1d98e74746 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:01.111985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9be06020-594f-476b-a121-358a945b846d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2ada08b7b74035bd2e183aaa70b9d2', 'request_id': 'req-9be06020-594f-476b-a121-358a945b846d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:01.126802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9be06020-594f-476b-a121-358a945b846d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2ada08b7b74035bd2e183aaa70b9d2', 'request_id': 'req-9be06020-594f-476b-a121-358a945b846d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:01.147927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9be06020-594f-476b-a121-358a945b846d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2ada08b7b74035bd2e183aaa70b9d2', 'request_id': 'req-9be06020-594f-476b-a121-358a945b846d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:01.178155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9be06020-594f-476b-a121-358a945b846d admin admin] The token cache is being invalidate because project 8d2ada08b7b74035bd2e183aaa70b9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:01.178363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9be06020-594f-476b-a121-358a945b846d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:01.179996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9be06020-594f-476b-a121-358a945b846d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:01.183771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 727/1439] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:00 2022] DELETE /identity/v3/projects/8d2ada08b7b74035bd2e183aaa70b9d2 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:01.188579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc7c77-97a8-4b8f-ab4f-1e7972239c7e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:01.188923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc7c77-97a8-4b8f-ab4f-1e7972239c7e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:01.189204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc7c77-97a8-4b8f-ab4f-1e7972239c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:01.246432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a3cc7c77-97a8-4b8f-ab4f-1e7972239c7e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:01.249446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a3cc7c77-97a8-4b8f-ab4f-1e7972239c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:01.286466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:01.322270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:01.326325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:01.328420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:01.330714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:01.339597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:01.435208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 728/1440] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:01.444998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b0b3-2179-4477-a7af-b59d7b707591 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:01.447388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b0b3-2179-4477-a7af-b59d7b707591 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:01.448493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b0b3-2179-4477-a7af-b59d7b707591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:01.499163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:01.501862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f4b7b0b3-2179-4477-a7af-b59d7b707591 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:01.502444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:01.503761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f4b7b0b3-2179-4477-a7af-b59d7b707591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:01.522360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 713/1441] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 20:06:01.529492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 729/1442] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:01.532592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:01.551119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0371404-6fa4-4a4b-bb58-455fe5e1dd48 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:01.565910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:01.566765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:01.567054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:01.568283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:01.572120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:01.573353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:01.575551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:01.616012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 714/1443] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:01.620385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b0b3-2179-4477-a7af-b59d7b707591 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:01.652537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b0b3-2179-4477-a7af-b59d7b707591 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:01.697245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:01.702741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:01.703129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:01.703322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:01.714148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:01.716106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:01.896044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 730/1444] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:01 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:01.900472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:01.918419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b0460-81d1-4532-9587-fdd15fe7958c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:02.133359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:02.248693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:02.249881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:02.250455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:02.251899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:02.254585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:02.258437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:02.354855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:02.357195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 715/1445] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:01 2022] POST /identity/v3/users => generated 283 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:02.382778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8683d-a7e5-49a8-aec5-c8e2b3d3f333 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:02.412054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:02.413085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:02.413694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:02.414254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:02.415850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:02.418274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:02.443694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:02.446300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 731/1446] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:02.495509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c33229-a0a6-43fc-8b2f-1dea232fff40 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:02.523134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d066b-2789-4570-8934-4076e1b72e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:02.531065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d066b-2789-4570-8934-4076e1b72e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:02.533433 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d066b-2789-4570-8934-4076e1b72e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:02.533568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d066b-2789-4570-8934-4076e1b72e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:02.538416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d066b-2789-4570-8934-4076e1b72e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:02.548783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d066b-2789-4570-8934-4076e1b72e66 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:02.630596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 716/1447] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:02.631314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:02.662907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a927-15c4-4ad2-bfa3-14a43ea0cf50 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:02.682501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:02.687517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:02.687517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:02.687517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] PATH_INFO: `/v3/projects/12d6e9513f0745488f99b22791e5531f/users/77a7d776d6b14cd2bfac9dd17e30147f/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:02.765364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d6e9513f0745488f99b22791e5531f, user_id=77a7d776d6b14cd2bfac9dd17e30147f, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:02.774604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:02.863334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 732/1448] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:02 2022] PUT /identity/v3/projects/12d6e9513f0745488f99b22791e5531f/users/77a7d776d6b14cd2bfac9dd17e30147f/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:02.864841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf78f26-d7ad-4093-a1ff-65b63c1da686 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:02.865133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf78f26-d7ad-4093-a1ff-65b63c1da686 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:02.865408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf78f26-d7ad-4093-a1ff-65b63c1da686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:02.959704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4bf78f26-d7ad-4093-a1ff-65b63c1da686 None None] MFA Rules not processed for user `77a7d776d6b14cd2bfac9dd17e30147f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:02.961075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4bf78f26-d7ad-4093-a1ff-65b63c1da686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:03.200612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:03.207299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 717/1449] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:03.445165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98ace7-57d6-4a8c-a00e-4ad06d11825e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:03.481377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:03.482014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:03.482395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:03.483480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:03.483920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:03.485824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:03.499254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d5df-1559-4685-819c-6273597650b5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:03.499551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d5df-1559-4685-819c-6273597650b5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:03.500017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d5df-1559-4685-819c-6273597650b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:03.666137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 733/1450] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:03 2022] POST /identity/v3/projects => generated 365 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:03.669909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:03.849429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:03.964390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c025d5df-1559-4685-819c-6273597650b5 None None] MFA Rules not processed for user `3f748dc73ef7444d9382a0680e027c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:03.966855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c025d5df-1559-4685-819c-6273597650b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:03.982537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ae4e6-13b7-44f2-94f6-043d60e342fd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:03.995397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:03.996104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:03.996439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:03.996616 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:03.997347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:04.026109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:04.145143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 734/1451] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:03 2022] POST /identity/v3/users => generated 289 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:04.148524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:04.160638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 718/1452] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Oct 23 20:06:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 662 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:04.175793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bc756-1f2d-456d-8a19-72162d5926bb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:04.194230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:04.194947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:04.195418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:04.195781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:04.196542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:04.200826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:04.221343 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d5df-1559-4685-819c-6273597650b5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:04.223089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c025d5df-1559-4685-819c-6273597650b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:04.242316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d5df-1559-4685-819c-6273597650b5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:04.250959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 735/1453] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:04.252673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:04.253594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:04.254390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:04.260487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:04.261982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:04.286730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:04.291585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:04.304365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407dcf0-a356-44a4-b670-a7e21adff407 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:04.318953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:04.319465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 719/1454] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:04.319704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:04.320180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:04.320477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] PATH_INFO: `/v3/projects/7a1d01e783a04ef88c660b2e8867f42c/users/451ea5c2ea2b4820964443696d7eb74e/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:04.382722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1d01e783a04ef88c660b2e8867f42c, user_id=451ea5c2ea2b4820964443696d7eb74e, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:04.385543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:04.449288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 736/1455] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:04 2022] PUT /identity/v3/projects/7a1d01e783a04ef88c660b2e8867f42c/users/451ea5c2ea2b4820964443696d7eb74e/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:04.455035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:04.472304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4661b9-fc9b-486c-ac3e-c4a6b29ed74f service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:04.582805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:04.630907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0d91b-11c4-4711-b22a-ce509f4bd3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:04.631538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d91b-11c4-4711-b22a-ce509f4bd3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:04.634492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d91b-11c4-4711-b22a-ce509f4bd3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:04.634825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d91b-11c4-4711-b22a-ce509f4bd3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:04.635466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0d91b-11c4-4711-b22a-ce509f4bd3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:04.640238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0d91b-11c4-4711-b22a-ce509f4bd3d6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:04.686196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 720/1456] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:04.687864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:04.703678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9995b40-0103-4de1-b21d-845794056b16 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:04.713373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:04.713959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:04.714270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:04.714551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] PATH_INFO: `/v3/projects/7a1d01e783a04ef88c660b2e8867f42c/users/451ea5c2ea2b4820964443696d7eb74e/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:04.731229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1d01e783a04ef88c660b2e8867f42c, user_id=451ea5c2ea2b4820964443696d7eb74e, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:04.735667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:04.775137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 737/1457] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:04 2022] PUT /identity/v3/projects/7a1d01e783a04ef88c660b2e8867f42c/users/451ea5c2ea2b4820964443696d7eb74e/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:04.783145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543f42-230b-45e0-8424-b2febc68345c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:04.783435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543f42-230b-45e0-8424-b2febc68345c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:04.783709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543f42-230b-45e0-8424-b2febc68345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:04.887259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-30543f42-230b-45e0-8424-b2febc68345c None None] MFA Rules not processed for user `451ea5c2ea2b4820964443696d7eb74e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:04.893926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-30543f42-230b-45e0-8424-b2febc68345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:05.125756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 721/1458] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:05.284718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:05.286759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:05.474012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c3ed5-4410-477a-96af-b6cade7bd5bb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:05.493789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:05.494472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:05.499440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:05.499593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:05.558501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:05.560120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:05.596432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 738/1459] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:05.989079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30543f42-230b-45e0-8424-b2febc68345c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:06.003833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30543f42-230b-45e0-8424-b2febc68345c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:06.012034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6e4bb-ba2c-43a1-9fce-f147eb019f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:06.012982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e4bb-ba2c-43a1-9fce-f147eb019f1c service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:06.013412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e4bb-ba2c-43a1-9fce-f147eb019f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:06.013891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e4bb-ba2c-43a1-9fce-f147eb019f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:06.163529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6e4bb-ba2c-43a1-9fce-f147eb019f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:06.165668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6e4bb-ba2c-43a1-9fce-f147eb019f1c service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:06.192840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 722/1460] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:07.863783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:07.865322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:08.070917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067c67-f8fa-489b-a090-845218c884f6 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:08.088975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:08.091395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:08.092890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:08.093731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] PATH_INFO: `/v3/users/891bc2148a6b42dcbcef2209f8761184` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:08.096276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891bc2148a6b42dcbcef2209f8761184)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:08.109038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:08.180116 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:08.225300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891bc2148a6b42dcbcef2209f8761184'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:08.252665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891bc2148a6b42dcbcef2209f8761184'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:08.253456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891bc2148a6b42dcbcef2209f8761184'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:08.254289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891bc2148a6b42dcbcef2209f8761184'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:08.269336 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891bc2148a6b42dcbcef2209f8761184'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:08.341480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 739/1461] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:07 2022] DELETE /identity/v3/users/891bc2148a6b42dcbcef2209f8761184 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:08.349296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923b222-6088-4cc3-aaed-5b6ca4db7cd1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:08.349885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923b222-6088-4cc3-aaed-5b6ca4db7cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:08.350125 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923b222-6088-4cc3-aaed-5b6ca4db7cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:08.460751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e923b222-6088-4cc3-aaed-5b6ca4db7cd1 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:08.462144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e923b222-6088-4cc3-aaed-5b6ca4db7cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:08.660850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:08.691922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 723/1462] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:08.907630 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:08.909858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:09.111339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269910-a400-43b4-a444-c9730e6aa585 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:09.115818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143d04-6185-4ee4-a1c3-26ce4bc6714b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:09.116740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143d04-6185-4ee4-a1c3-26ce4bc6714b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:09.117007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143d04-6185-4ee4-a1c3-26ce4bc6714b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:09.118904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 724/1463] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:06:09.130945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:09.131847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:09.134215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:09.136593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:09.179055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:09.180566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:09.197039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 740/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:09.241442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3bd76-fe0b-48f7-ac63-f254f5e9c9f3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:09.242381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3bd76-fe0b-48f7-ac63-f254f5e9c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:09.242741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3bd76-fe0b-48f7-ac63-f254f5e9c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:09.301561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-09f3bd76-fe0b-48f7-ac63-f254f5e9c9f3 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:09.301561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-09f3bd76-fe0b-48f7-ac63-f254f5e9c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:09.554230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 725/1465] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:06:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:09.598599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:09.600156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:09.642342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc4530-079f-4a91-8b5d-e6f6c62f4072 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:09.653562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bd4f-286a-4ce2-a435-ef6145251dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:09.654546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd4f-286a-4ce2-a435-ef6145251dbf service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:09.655038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd4f-286a-4ce2-a435-ef6145251dbf service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:09.655325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bd4f-286a-4ce2-a435-ef6145251dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:09.694352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bd4f-286a-4ce2-a435-ef6145251dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:09.696628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bd4f-286a-4ce2-a435-ef6145251dbf service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:09.750518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 741/1466] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:09.910864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fc714-4fa1-4a69-a999-739cf3fe4d78 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:09.911391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fc714-4fa1-4a69-a999-739cf3fe4d78 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:09.911877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fc714-4fa1-4a69-a999-739cf3fe4d78 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:09.913700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 726/1467] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:06:09.945477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30747e8-c9d9-4277-bf4a-8feaebc927e1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:09.946389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30747e8-c9d9-4277-bf4a-8feaebc927e1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:09.946847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30747e8-c9d9-4277-bf4a-8feaebc927e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:10.013408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f30747e8-c9d9-4277-bf4a-8feaebc927e1 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:10.016012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f30747e8-c9d9-4277-bf4a-8feaebc927e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:10.149143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 742/1468] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:06:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:10.170821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fc714-4fa1-4a69-a999-739cf3fe4d78 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:10.173353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9b3fc714-4fa1-4a69-a999-739cf3fe4d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:10.206324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fc714-4fa1-4a69-a999-739cf3fe4d78 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:10.211541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:10.212439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:10.212929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:10.214212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] PATH_INFO: `/v3/users/499b76ba168140c1be2b670b1723030e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:10.215831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=499b76ba168140c1be2b670b1723030e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:10.218914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:10.361316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499b76ba168140c1be2b670b1723030e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:10.373156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499b76ba168140c1be2b670b1723030e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:10.405782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499b76ba168140c1be2b670b1723030e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:10.409324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499b76ba168140c1be2b670b1723030e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:10.444930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499b76ba168140c1be2b670b1723030e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:10.456884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 727/1469] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:10 2022] DELETE /identity/v3/users/499b76ba168140c1be2b670b1723030e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:10.461572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:10.461905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:10.462197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:10.488570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:10.489979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:10.650031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 743/1470] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:10.665808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:10.667617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:10.730413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:10.732120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:10.853745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:10.939021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad711509-8fe5-4fe5-97b9-23a4482d23ed admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:10.948773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:10.949636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:10.950536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:10.950874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:10.964509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:10.968440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:10.999372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 728/1471] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:11.000651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19e14e-4a2f-4afb-8ada-d3a1e94fac90 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:11.012126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e8c5-aa6c-4056-83e4-5714e4be071f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:11.012981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e8c5-aa6c-4056-83e4-5714e4be071f service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:11.013431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e8c5-aa6c-4056-83e4-5714e4be071f service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:11.014068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e8c5-aa6c-4056-83e4-5714e4be071f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:11.016609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9ca5e8c5-aa6c-4056-83e4-5714e4be071f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:11.036925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e8c5-aa6c-4056-83e4-5714e4be071f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:11.039486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e8c5-aa6c-4056-83e4-5714e4be071f service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:11.059256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 744/1472] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:12.053496 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:12.055288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:12.076623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:12.084038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d068-26f2-4496-b504-3bcb8afd0057 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:12.104147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:12.104942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:12.105237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:12.105598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] PATH_INFO: `/v3/users/6a267973f5aa4e8a8d600cb90947447d` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:12.107978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a267973f5aa4e8a8d600cb90947447d)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:12.110874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:12.276680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a267973f5aa4e8a8d600cb90947447d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:12.318512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a267973f5aa4e8a8d600cb90947447d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:12.346056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a267973f5aa4e8a8d600cb90947447d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:12.347604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a267973f5aa4e8a8d600cb90947447d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:12.378603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a267973f5aa4e8a8d600cb90947447d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:12.391458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 729/1473] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:12 2022] DELETE /identity/v3/users/6a267973f5aa4e8a8d600cb90947447d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:12.396705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:12.398187 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:12.398893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:12.437270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:12.439483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:12.627260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 745/1474] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:12.671731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:12.674666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:12.799013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e43f-1c83-4a59-8204-d2424a2bf296 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:12.803551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:12.805468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:12.815462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:12.816308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:12.816771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:12.817238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:12.830535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab67ab6-bdee-4aaf-a715-2f2a1d7c829d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:12.840905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:12.841596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:12.842133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:12.842456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] PATH_INFO: `/v3/projects/2a66b07f11054a60a094c435abc7648e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:12.843729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a66b07f11054a60a094c435abc7648e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:12.845948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:12.861344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:12.863171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:12.886239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 730/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:12.961402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a66b07f11054a60a094c435abc7648e', 'request_id': 'req-69e54bf3-834e-4dca-8974-7361901c4bbb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:12.991210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a66b07f11054a60a094c435abc7648e', 'request_id': 'req-69e54bf3-834e-4dca-8974-7361901c4bbb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.008577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a66b07f11054a60a094c435abc7648e', 'request_id': 'req-69e54bf3-834e-4dca-8974-7361901c4bbb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.027196 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] The token cache is being invalidate because project 2a66b07f11054a60a094c435abc7648e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:13.027493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.028217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.042550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 746/1476] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:12 2022] DELETE /identity/v3/projects/2a66b07f11054a60a094c435abc7648e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:13.044344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:13.070069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148b702-11ba-45ec-92b5-95d0243e6a2a service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:13.286355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:13.288222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:13.288501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:13.289265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] PATH_INFO: `/v3/users/b18755eda7a745a7833d2c8a638ec251` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:13.293012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18755eda7a745a7833d2c8a638ec251)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:13.295843 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:13.372501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:13.446748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18755eda7a745a7833d2c8a638ec251'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.470551 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18755eda7a745a7833d2c8a638ec251'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.492213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18755eda7a745a7833d2c8a638ec251'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.492950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18755eda7a745a7833d2c8a638ec251'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.509727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:13.511916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:13.519082 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18755eda7a745a7833d2c8a638ec251'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.535144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 731/1477] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:13 2022] DELETE /identity/v3/users/b18755eda7a745a7833d2c8a638ec251 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:13.538987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e54bf3-834e-4dca-8974-7361901c4bbb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:13.630333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:13.660499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:13.668564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:13.764395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:13.765243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:13.765669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:13.766116 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] PATH_INFO: `/v3/projects/017676ca8d074a85b1f6835a593cd472` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:13.767650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=017676ca8d074a85b1f6835a593cd472)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:13.777834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:13.928328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017676ca8d074a85b1f6835a593cd472', 'request_id': 'req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.936999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11c20-9b89-4ce1-a4fd-2385b728821b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:13.943671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017676ca8d074a85b1f6835a593cd472', 'request_id': 'req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.961541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017676ca8d074a85b1f6835a593cd472', 'request_id': 'req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.995695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] The token cache is being invalidate because project 017676ca8d074a85b1f6835a593cd472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:13.996106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:13.996886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.002318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 747/1478] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:13 2022] DELETE /identity/v3/projects/017676ca8d074a85b1f6835a593cd472 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:14.003517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:14.005075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:14.088029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:14.090408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:14.090879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:14.091807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] PATH_INFO: `/v3/projects/494f4f7794ba4edea007282badbf1a79` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:14.093515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494f4f7794ba4edea007282badbf1a79)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:14.096166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:14.181705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:14.184201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494f4f7794ba4edea007282badbf1a79', 'request_id': 'req-d106a68d-abc2-4423-aba7-e235d3251b99'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.237765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494f4f7794ba4edea007282badbf1a79', 'request_id': 'req-d106a68d-abc2-4423-aba7-e235d3251b99'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.241381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3e42e-beb0-49e6-8cf9-787d9ad04b7f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:14.260206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494f4f7794ba4edea007282badbf1a79', 'request_id': 'req-d106a68d-abc2-4423-aba7-e235d3251b99'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.308434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] The token cache is being invalidate because project 494f4f7794ba4edea007282badbf1a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:14.308747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.311280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.319249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 732/1479] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:13 2022] DELETE /identity/v3/projects/494f4f7794ba4edea007282badbf1a79 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:14.323873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:14.325115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:14.448290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:14.448860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:14.449140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:14.449423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] PATH_INFO: `/v3/users/11dd4ec73203422095cdb2445d9d2d96` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:14.463004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dd4ec73203422095cdb2445d9d2d96)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:14.465128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:14.485749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:14.529834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a68d-abc2-4423-aba7-e235d3251b99 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:14.554850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:14.557070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:14.557865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:14.558794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] PATH_INFO: `/v3/users/fbff5d41c72e4f7f988893dfd484ace4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:14.563515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbff5d41c72e4f7f988893dfd484ace4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:14.571856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:14.578304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dd4ec73203422095cdb2445d9d2d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.619479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dd4ec73203422095cdb2445d9d2d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.621240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dd4ec73203422095cdb2445d9d2d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.622690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dd4ec73203422095cdb2445d9d2d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.641848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dd4ec73203422095cdb2445d9d2d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.670731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 748/1480] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:14 2022] DELETE /identity/v3/users/11dd4ec73203422095cdb2445d9d2d96 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:14.675719 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbff5d41c72e4f7f988893dfd484ace4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.683968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbff5d41c72e4f7f988893dfd484ace4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.694972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbff5d41c72e4f7f988893dfd484ace4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.695741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbff5d41c72e4f7f988893dfd484ace4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.711318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbff5d41c72e4f7f988893dfd484ace4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:14.720857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 733/1481] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:14 2022] DELETE /identity/v3/users/fbff5d41c72e4f7f988893dfd484ace4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:14.795921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:14.797424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:14.890319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bc26d-8435-4628-9fd1-a6de707568f4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.015100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.017273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.018027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.018339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] PATH_INFO: `/v3/projects/23fa52b988da4dc4963f67264e1104fc` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.019553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23fa52b988da4dc4963f67264e1104fc)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.022659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.072149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.074054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.081349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:15.090807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fa52b988da4dc4963f67264e1104fc', 'request_id': 'req-b40cbba9-d30b-4be3-aa2e-114ecefaa893'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.100841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884579-08aa-4e26-8f11-8a8edfee27c8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.102901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fa52b988da4dc4963f67264e1104fc', 'request_id': 'req-b40cbba9-d30b-4be3-aa2e-114ecefaa893'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.117740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fa52b988da4dc4963f67264e1104fc', 'request_id': 'req-b40cbba9-d30b-4be3-aa2e-114ecefaa893'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.140479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] The token cache is being invalidate because project 23fa52b988da4dc4963f67264e1104fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:15.141079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.142280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.147603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 749/1482] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:14 2022] DELETE /identity/v3/projects/23fa52b988da4dc4963f67264e1104fc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:15.149062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.150474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.203713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:15.212374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.213965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.214580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.215235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] PATH_INFO: `/v3/users/77a7d776d6b14cd2bfac9dd17e30147f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.218810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a7d776d6b14cd2bfac9dd17e30147f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.224633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.308428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cbba9-d30b-4be3-aa2e-114ecefaa893 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.318720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.319382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.319638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.319914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] PATH_INFO: `/v3/projects/e1a588bce0134452987200b00737b3a8` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.321780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a588bce0134452987200b00737b3a8)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.324124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a7d776d6b14cd2bfac9dd17e30147f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.329863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.338371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a7d776d6b14cd2bfac9dd17e30147f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.353727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a7d776d6b14cd2bfac9dd17e30147f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.354900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a7d776d6b14cd2bfac9dd17e30147f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.377413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a7d776d6b14cd2bfac9dd17e30147f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.393209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 734/1483] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:15 2022] DELETE /identity/v3/users/77a7d776d6b14cd2bfac9dd17e30147f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:15.394224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.395779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.400425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a588bce0134452987200b00737b3a8', 'request_id': 'req-dc362f70-058c-43af-827d-725259ff216c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.425317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a588bce0134452987200b00737b3a8', 'request_id': 'req-dc362f70-058c-43af-827d-725259ff216c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.435260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a588bce0134452987200b00737b3a8', 'request_id': 'req-dc362f70-058c-43af-827d-725259ff216c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.448666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] The token cache is being invalidate because project e1a588bce0134452987200b00737b3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:15.448973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.449645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dc362f70-058c-43af-827d-725259ff216c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.451573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 750/1484] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:15 2022] DELETE /identity/v3/projects/e1a588bce0134452987200b00737b3a8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:15.452703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7917-233b-4624-83ef-589d249fa4a6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.452985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7917-233b-4624-83ef-589d249fa4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.453686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7917-233b-4624-83ef-589d249fa4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.475848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4eaa7917-233b-4624-83ef-589d249fa4a6 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:15.477070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4eaa7917-233b-4624-83ef-589d249fa4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.485305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 751/1485] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:15.486608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b576d9a-4b87-414e-a93c-5479d95a8f99 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.486898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b576d9a-4b87-414e-a93c-5479d95a8f99 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.487171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b576d9a-4b87-414e-a93c-5479d95a8f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.487998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f563f-7bbd-4bb4-b5db-a2e64dd82b50 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.492742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.493471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.493835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.494207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] PATH_INFO: `/v3/projects/0701ff4ee3ae4741bc01d3fb557657f0` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.495405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0701ff4ee3ae4741bc01d3fb557657f0)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.497368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.506785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0b576d9a-4b87-414e-a93c-5479d95a8f99 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:15.508129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0b576d9a-4b87-414e-a93c-5479d95a8f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.517373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 752/1486] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:15.518793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.519079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.519358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.541448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:15.542666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.546253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0701ff4ee3ae4741bc01d3fb557657f0', 'request_id': 'req-90dbd3db-5aee-4ec6-8975-7ecec188276f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.552340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0701ff4ee3ae4741bc01d3fb557657f0', 'request_id': 'req-90dbd3db-5aee-4ec6-8975-7ecec188276f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.560314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0701ff4ee3ae4741bc01d3fb557657f0', 'request_id': 'req-90dbd3db-5aee-4ec6-8975-7ecec188276f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.572951 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] The token cache is being invalidate because project 0701ff4ee3ae4741bc01d3fb557657f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:15.573247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.573923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-90dbd3db-5aee-4ec6-8975-7ecec188276f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:15.575468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 735/1487] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:15 2022] DELETE /identity/v3/projects/0701ff4ee3ae4741bc01d3fb557657f0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:15.577286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7437-1da1-4fc6-a3ea-e0b506835569 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.577571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7437-1da1-4fc6-a3ea-e0b506835569 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.577961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7437-1da1-4fc6-a3ea-e0b506835569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.586503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:15.589805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:15.600408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-58eb7437-1da1-4fc6-a3ea-e0b506835569 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:15.601804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-58eb7437-1da1-4fc6-a3ea-e0b506835569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.613803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 753/1488] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:15.614752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.616227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.665715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 736/1489] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:15.667043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547fa8d-589f-4b48-b162-d992e8a7836e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.667525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547fa8d-589f-4b48-b162-d992e8a7836e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.667795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547fa8d-589f-4b48-b162-d992e8a7836e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.687888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9a852-e17d-4eee-9993-d9b4bb0541f6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.689705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2547fa8d-589f-4b48-b162-d992e8a7836e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:15.690946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2547fa8d-589f-4b48-b162-d992e8a7836e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.692190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.692802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.693077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.693367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.695147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.699308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 737/1490] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:15.700524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69a97b-b8b2-4202-82fe-de80f01801b0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.700807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69a97b-b8b2-4202-82fe-de80f01801b0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.701193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69a97b-b8b2-4202-82fe-de80f01801b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.710709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.712179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.722306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 754/1491] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:15.723145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.733854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba620f4-a978-4983-9339-c24d917c5514 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.734442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7e69a97b-b8b2-4202-82fe-de80f01801b0 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:15.735728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7e69a97b-b8b2-4202-82fe-de80f01801b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.743975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.744783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 738/1492] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:15.744923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.745241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.745713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.746516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:15.746917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.749004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.749379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033d140-53e2-446c-a9c9-75199da0187a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.749724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033d140-53e2-446c-a9c9-75199da0187a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.749976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033d140-53e2-446c-a9c9-75199da0187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.767391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 755/1493] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:15.767391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.777472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6033d140-53e2-446c-a9c9-75199da0187a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:15.779815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6033d140-53e2-446c-a9c9-75199da0187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:15.781633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5db4d-c416-4610-8986-93656a3d3477 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.788101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.789330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.789711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.790132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.791015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:15.791498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.796792 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.797371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 739/1494] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:15.798513 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033d140-53e2-446c-a9c9-75199da0187a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.810068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033d140-53e2-446c-a9c9-75199da0187a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.817757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.818665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.819217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.819633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.820419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.822878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.832118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 756/1495] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:15.833251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.849057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33280a7-a470-40b7-b745-52fc17de8005 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.866922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.867537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.867908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.868189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.868836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:15.869129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.870861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.874831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 740/1496] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:15.874831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.886691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 757/1497] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:15.887512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:15.898464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2615fb-f3b9-42b3-8c9e-ec5427507b7c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.956086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed9c03-e1b5-4f6a-94b4-2a587fac6c27 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:15.961703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.962646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.963036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.963518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.964777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.966999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:15.977134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:15.978122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:15.978348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:15.979122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:15.979852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:15.983286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.003693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 741/1498] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:16.005854 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.017386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 758/1499] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:15 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:16.018589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.034609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb3fa7-d121-4c04-8702-4dc00e639005 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.068638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:16.079984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:16.085189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a857b6-5abf-415a-a2be-562633988db0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.093056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.094048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.094366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.094644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.095658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.098442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.108985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.109695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.109934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.110243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.111159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.113418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.131639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 742/1500] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:16 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:16.132605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.142262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 759/1501] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:16 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:16.143477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.156365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db695b8-3ce8-41ef-8545-83d6553cb0e9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.210975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b71f5-1826-4195-9b64-993814a6b9d3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.215601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.216207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.216486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.217309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.217863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.218106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.218452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.218764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.219042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.219544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.219717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.221886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.229203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 743/1502] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:16.229203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.233432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.245451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 760/1503] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:16 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:16.246497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.246769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bacea3-0b8f-4bca-92c1-81d015c14071 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.251812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.252452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.252735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.253011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] PATH_INFO: `/v3/projects/12d6e9513f0745488f99b22791e5531f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.254251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d6e9513f0745488f99b22791e5531f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.256089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.256240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c75f7-a9a1-4366-a95d-36a0e8ff585c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.260973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.261623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.261974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.262341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.263078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.264711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.275723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 761/1504] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:16.276390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.287662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8029a-2bbc-4d9f-811d-8c0987ef3bc2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.292603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.293199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.293494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.293746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.294537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.296332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.307816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 762/1505] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:16.308491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.315767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d6e9513f0745488f99b22791e5531f', 'request_id': 'req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.321029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174ce58-3d6c-4cf4-b21f-6af09b6d6edf admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.323060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d6e9513f0745488f99b22791e5531f', 'request_id': 'req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.331446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d6e9513f0745488f99b22791e5531f', 'request_id': 'req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.342204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] The token cache is being invalidate because project 12d6e9513f0745488f99b22791e5531f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:16.342601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.343335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.344834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 744/1506] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:16 2022] DELETE /identity/v3/projects/12d6e9513f0745488f99b22791e5531f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:16.345678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.347016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.380950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.381582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.381852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.382144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.382858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.384451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.394860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 763/1507] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:16.395654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.397300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.405104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:16.409400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d19c8-15fa-4680-89fa-20fb0b3e28dd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.414126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.414770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.415050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.415330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] PATH_INFO: `/v3/projects/bd9ea837561c4855a1c87bc2b7702c81/users/c87f3711792b4387a365260a2d473373/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.419088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8ac1f-8b5c-4fb7-b0a4-a300b3eaf86b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.425074 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.425685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.425964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.426275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.426921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.428630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.431008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9ea837561c4855a1c87bc2b7702c81, user_id=c87f3711792b4387a365260a2d473373, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.433724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.439553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 745/1508] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:16.440667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.442722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.454659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 764/1509] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:16 2022] PUT /identity/v3/projects/bd9ea837561c4855a1c87bc2b7702c81/users/c87f3711792b4387a365260a2d473373/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:16.455661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.457552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.462457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a4e6c-54f9-4116-bf5f-ea667429bf7a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.478678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:16.537194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.539400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.540241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.540599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] PATH_INFO: `/v3/users/451ea5c2ea2b4820964443696d7eb74e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.542788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=451ea5c2ea2b4820964443696d7eb74e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.546424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.555496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56f157-55f2-47c3-9bf0-3629f7e8767a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.561264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.566566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.567043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.569576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.570298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.571945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.585645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 765/1510] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:16.586917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.599046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cdb3-9d4f-47f0-a5b0-c9935819940b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.608163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.610160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.611486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.613239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] PATH_INFO: `/v3/projects/a6323958b69748b78560ffd82da9cca9/users/61e0ec0e75f94bc5af7d4cdc37aad651/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.618961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451ea5c2ea2b4820964443696d7eb74e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.631051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451ea5c2ea2b4820964443696d7eb74e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.634113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6323958b69748b78560ffd82da9cca9, user_id=61e0ec0e75f94bc5af7d4cdc37aad651, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.639304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.642657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451ea5c2ea2b4820964443696d7eb74e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.643767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451ea5c2ea2b4820964443696d7eb74e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.659361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e745ce88-2b65-49df-aa41-a18b279a85bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451ea5c2ea2b4820964443696d7eb74e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:16.666398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 746/1511] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:16 2022] DELETE /identity/v3/users/451ea5c2ea2b4820964443696d7eb74e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:16.667695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8190f-6915-4bc3-b85f-85c5f86c67f9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.668044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8190f-6915-4bc3-b85f-85c5f86c67f9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.668567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8190f-6915-4bc3-b85f-85c5f86c67f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.682393 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 766/1512] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:16 2022] PUT /identity/v3/projects/a6323958b69748b78560ffd82da9cca9/users/61e0ec0e75f94bc5af7d4cdc37aad651/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:16.685400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.688046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.716627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2df8190f-6915-4bc3-b85f-85c5f86c67f9 None None] MFA Rules not processed for user `c87f3711792b4387a365260a2d473373`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:16.718199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2df8190f-6915-4bc3-b85f-85c5f86c67f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.769053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f567733-e884-49a5-973d-8f99c8e67b29 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.790112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:16.801535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 747/1513] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:16.803374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec6ff-c604-4c2d-920e-c99bd91f1635 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.803828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec6ff-c604-4c2d-920e-c99bd91f1635 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.804204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec6ff-c604-4c2d-920e-c99bd91f1635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.837031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:16.837279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f10ec6ff-c604-4c2d-920e-c99bd91f1635 None None] MFA Rules not processed for user `61e0ec0e75f94bc5af7d4cdc37aad651`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:16.838155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.838304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f10ec6ff-c604-4c2d-920e-c99bd91f1635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.838426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.838705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] PATH_INFO: `/v3/projects/44f7f11a75994338970821fd7f5b350e/users/333e3b219d3b4ee391974a40a6420bce/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.855344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f7f11a75994338970821fd7f5b350e, user_id=333e3b219d3b4ee391974a40a6420bce, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:16.858428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:16.906067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 767/1514] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:16 2022] PUT /identity/v3/projects/44f7f11a75994338970821fd7f5b350e/users/333e3b219d3b4ee391974a40a6420bce/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:16.907164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:16.909640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.924545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:16.932755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 748/1515] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:16.934292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717409-7548-43c0-a37f-d7001e24880f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:16.934728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717409-7548-43c0-a37f-d7001e24880f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:16.935148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717409-7548-43c0-a37f-d7001e24880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:16.970069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c0717409-7548-43c0-a37f-d7001e24880f None None] MFA Rules not processed for user `333e3b219d3b4ee391974a40a6420bce`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:16.971599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c0717409-7548-43c0-a37f-d7001e24880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:16.992615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a81d82-96eb-4d6e-a3a4-9e3b4312fc91 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:16.999333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.000018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.000371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.001143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.001424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.004814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.038560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 768/1516] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:16 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:17.039725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.048526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:17.057594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 749/1517] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:17.059744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0717409-7548-43c0-a37f-d7001e24880f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.074885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0717409-7548-43c0-a37f-d7001e24880f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.127060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1e19-5d2a-4e22-a620-a876038a0bec admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.133099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.133838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.134261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.134636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.135365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.137361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.154865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.155683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.155978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.156334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.157375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.160100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.179167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 769/1518] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:17 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:17.179167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.191562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 750/1519] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:17 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:17.192694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.226355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737860e-7fc3-4402-8035-cd7d4ee65530 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.232965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:17.266779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a63dc-d246-41d0-b0f6-c96b0551e248 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.278594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.280507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.280868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.281218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.282110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.285357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.326765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 770/1520] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:17 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:17.327558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.328048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.328830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.329209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.329666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.330570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.333320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.333724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:17.361492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 751/1521] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:17 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:17.362741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.365080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:17.380876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81989c-b1f4-4351-a814-bda160f47c50 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.407045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c13b9-8d16-42fa-b6f5-96451f993d3c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.411848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.412456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.412744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.413017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.413684 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.415350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.425274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 771/1522] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:17.426122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.437062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86e923-34e3-4123-8dbc-60cb2de6e28d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.441622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.442225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.442505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.442775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.443387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.444668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.445251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.445432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.445779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.446147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] PATH_INFO: `/v3/projects/7a1d01e783a04ef88c660b2e8867f42c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.447331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1d01e783a04ef88c660b2e8867f42c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.449293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.467660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 772/1523] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:17 2022] POST /identity/v3/users => generated 300 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:17.468466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.477894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2f15-dd5c-4a6d-9b60-4c9c3ee3f50b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.482980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.483606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.483892 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.484170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.484799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.486457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.497164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1d01e783a04ef88c660b2e8867f42c', 'request_id': 'req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:17.497602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 773/1524] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:17.499550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.504554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1d01e783a04ef88c660b2e8867f42c', 'request_id': 'req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:17.509257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418214-ec46-4d4a-b822-e353d9655908 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.512188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1d01e783a04ef88c660b2e8867f42c', 'request_id': 'req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:17.523549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] The token cache is being invalidate because project 7a1d01e783a04ef88c660b2e8867f42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:17.523839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:17.524479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:17.525965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 752/1525] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:17 2022] DELETE /identity/v3/projects/7a1d01e783a04ef88c660b2e8867f42c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:17.526756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.528034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:17.560046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:17.573638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.574355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.574632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.574913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] PATH_INFO: `/v3/projects/8dc9a56f7b9a4850808a6e19ee675c5a/users/17c7400c60174bc6be3eb89f7d979562/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.590690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc9a56f7b9a4850808a6e19ee675c5a, user_id=17c7400c60174bc6be3eb89f7d979562, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.593543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.597232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a820b5b-8279-47fa-bafd-32b6b4ab15ff admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.603665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b5860-b6d5-4b9f-8b4a-c05345db73ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.604267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b5860-b6d5-4b9f-8b4a-c05345db73ab admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.604696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b5860-b6d5-4b9f-8b4a-c05345db73ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.604967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b5860-b6d5-4b9f-8b4a-c05345db73ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.605718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b5860-b6d5-4b9f-8b4a-c05345db73ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.607526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b5860-b6d5-4b9f-8b4a-c05345db73ab admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.611289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 774/1526] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:17 2022] PUT /identity/v3/projects/8dc9a56f7b9a4850808a6e19ee675c5a/users/17c7400c60174bc6be3eb89f7d979562/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:17.611289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.613021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:17.621604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 753/1527] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:17.621604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.621604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.621604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.642483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:17.643691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:17.674690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:17.680177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1c1a-5fbd-4446-87df-969e3ece2763 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.687497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.688461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.688749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.689029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] PATH_INFO: `/v3/projects/49f5468ea4104bf18e75d89686f89e68/users/e0e8392622e243d3821e62001f3c8cd7/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.711978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f5468ea4104bf18e75d89686f89e68, user_id=e0e8392622e243d3821e62001f3c8cd7, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.719050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 754/1528] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:17.719050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.719277 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.719383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:17.731745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599e1c5-fbdb-4eb9-a339-bb366c3af943 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.738917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 775/1529] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:17 2022] PUT /identity/v3/projects/49f5468ea4104bf18e75d89686f89e68/users/e0e8392622e243d3821e62001f3c8cd7/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:17.738917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.813543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6eec0-c69c-4034-8a00-cb60e1abfbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.813958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6eec0-c69c-4034-8a00-cb60e1abfbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.814326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6eec0-c69c-4034-8a00-cb60e1abfbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.814665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6eec0-c69c-4034-8a00-cb60e1abfbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.815390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6eec0-c69c-4034-8a00-cb60e1abfbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.817102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6eec0-c69c-4034-8a00-cb60e1abfbd4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.829247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 755/1530] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:17.830877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad1b2-71a8-40cd-8ad0-7593aefd94fc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.830999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad1b2-71a8-40cd-8ad0-7593aefd94fc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.831393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad1b2-71a8-40cd-8ad0-7593aefd94fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.835620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2b11-746a-40e2-a8a6-ff602fbdbed8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.841610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.842380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.843222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.843553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] PATH_INFO: `/v3/projects/136baca44be8456d83668576a4c8842b/users/94d561bedfe94792b14640dc29155599/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.856700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-565ad1b2-71a8-40cd-8ad0-7593aefd94fc None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:17.858655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-565ad1b2-71a8-40cd-8ad0-7593aefd94fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:17.863785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=136baca44be8456d83668576a4c8842b, user_id=94d561bedfe94792b14640dc29155599, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.867122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.870233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 756/1531] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:17.872598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ad1b2-71a8-40cd-8ad0-7593aefd94fc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.891621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ad1b2-71a8-40cd-8ad0-7593aefd94fc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.896542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 776/1532] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:17 2022] PUT /identity/v3/projects/136baca44be8456d83668576a4c8842b/users/94d561bedfe94792b14640dc29155599/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:17.899705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.949132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:17.963438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.964891 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.965187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.965470 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.967284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.969485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.983260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0252953-9556-432d-bc2d-5182f73da46c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:17.984082 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 757/1533] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:17.988133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:17.990795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:17.991587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:17.991994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:17.992373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] PATH_INFO: `/v3/projects/8dc9a56f7b9a4850808a6e19ee675c5a/users/17c7400c60174bc6be3eb89f7d979562/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:17.994641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc9a56f7b9a4850808a6e19ee675c5a, user_id=17c7400c60174bc6be3eb89f7d979562, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:17.998415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:17.999052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ca37b-fed3-44b9-b794-33667acd3a75 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.005339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.006458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.006745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.007022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.007972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:18.008417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.010173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.011599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 777/1534] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:17 2022] PUT /identity/v3/projects/8dc9a56f7b9a4850808a6e19ee675c5a/users/17c7400c60174bc6be3eb89f7d979562/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:18.012773 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.034022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 758/1535] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:18.035085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.049238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3e64-75ba-4c5b-8ade-fc6f53fa4a73 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.091862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:18.098099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feb99a-3f3b-45cb-84ce-12c617553abc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.104425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b45c38-55f3-45c8-a50b-97c96c60b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.105309 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b45c38-55f3-45c8-a50b-97c96c60b656 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.105817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b45c38-55f3-45c8-a50b-97c96c60b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.106438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b45c38-55f3-45c8-a50b-97c96c60b656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.107731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b45c38-55f3-45c8-a50b-97c96c60b656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.109563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b45c38-55f3-45c8-a50b-97c96c60b656 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.121349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 778/1536] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:18.122972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef152e-bfab-4319-8d78-293859938e41 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.124015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef152e-bfab-4319-8d78-293859938e41 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.124364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef152e-bfab-4319-8d78-293859938e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.138041 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.139125 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.139492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.139897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] PATH_INFO: `/v3/projects/49f5468ea4104bf18e75d89686f89e68/users/e0e8392622e243d3821e62001f3c8cd7/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.144379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f5468ea4104bf18e75d89686f89e68, user_id=e0e8392622e243d3821e62001f3c8cd7, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.148449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.155548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cbef152e-bfab-4319-8d78-293859938e41 None None] MFA Rules not processed for user `17c7400c60174bc6be3eb89f7d979562`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:18.156867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cbef152e-bfab-4319-8d78-293859938e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:18.163091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 759/1537] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:18 2022] PUT /identity/v3/projects/49f5468ea4104bf18e75d89686f89e68/users/e0e8392622e243d3821e62001f3c8cd7/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:18.164440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.266028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f459e-8203-408c-a00b-c238410fa876 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.271013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a67058-6a21-46a3-a5f5-33e143a0861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.271720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67058-6a21-46a3-a5f5-33e143a0861e admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.272073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67058-6a21-46a3-a5f5-33e143a0861e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.272419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67058-6a21-46a3-a5f5-33e143a0861e admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.273138 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a67058-6a21-46a3-a5f5-33e143a0861e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.275361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a67058-6a21-46a3-a5f5-33e143a0861e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.284355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 779/1538] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:18.285460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef152e-bfab-4319-8d78-293859938e41 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.317083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef152e-bfab-4319-8d78-293859938e41 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.321581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 760/1539] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:18 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:18.323366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48a7c-e2c6-4be4-8a96-069a98343e22 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.323648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48a7c-e2c6-4be4-8a96-069a98343e22 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.323977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48a7c-e2c6-4be4-8a96-069a98343e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.325387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.327854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.328513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.329108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] PATH_INFO: `/v3/projects/136baca44be8456d83668576a4c8842b/users/94d561bedfe94792b14640dc29155599/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.331660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136baca44be8456d83668576a4c8842b, user_id=94d561bedfe94792b14640dc29155599, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.335505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.350594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 780/1540] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:18 2022] PUT /identity/v3/projects/136baca44be8456d83668576a4c8842b/users/94d561bedfe94792b14640dc29155599/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:18.351732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.353564 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:18.367775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b5d48a7c-e2c6-4be4-8a96-069a98343e22 None None] MFA Rules not processed for user `e0e8392622e243d3821e62001f3c8cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:18.369311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b5d48a7c-e2c6-4be4-8a96-069a98343e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:18.421549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:18.457169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 761/1541] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:18.459043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48a7c-e2c6-4be4-8a96-069a98343e22 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.473802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af2d12-b4e2-4866-828b-69ff5758ca17 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.479260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70107b7-745e-44b5-a96b-67db13a7aae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.480108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70107b7-745e-44b5-a96b-67db13a7aae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.480388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70107b7-745e-44b5-a96b-67db13a7aae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.480656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70107b7-745e-44b5-a96b-67db13a7aae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.540982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48a7c-e2c6-4be4-8a96-069a98343e22 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.546726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.547354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.547643 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.547920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.548917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.551865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.566356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70107b7-745e-44b5-a96b-67db13a7aae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.568488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70107b7-745e-44b5-a96b-67db13a7aae4 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.584018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 781/1542] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:18.585556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21833417-bf36-4ded-9a26-43b22152dbb2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.585896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21833417-bf36-4ded-9a26-43b22152dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.586206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21833417-bf36-4ded-9a26-43b22152dbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.605124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 762/1543] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:18 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:18.605814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.610546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:18.637868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:18.643458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-21833417-bf36-4ded-9a26-43b22152dbb2 None None] MFA Rules not processed for user `94d561bedfe94792b14640dc29155599`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:18.644133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-21833417-bf36-4ded-9a26-43b22152dbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:18.646055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaf6b8-bf32-449f-9283-dd12264f2be9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.652165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.652699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.653825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.654194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.656989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:18.746253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.747098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 782/1544] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:18.748419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21833417-bf36-4ded-9a26-43b22152dbb2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.753257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.764959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21833417-bf36-4ded-9a26-43b22152dbb2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.770607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.771229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.771513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.771792 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.772599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.773010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 763/1545] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:18.775924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.787858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.795775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee8d4c-4868-4555-b809-ca49db4cf12e service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.808786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.809588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.810011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.810507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.815719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 783/1546] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:18.816803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.822718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.824215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.837550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 764/1547] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:18.840537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f431-575b-4d39-8b01-a7185c8355ed admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.855815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.856615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.859563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.860261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.863300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.864937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.869764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.882697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a387f-5226-451a-8f88-e6e813aa61d4 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.887807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.888372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.889484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.889821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] PATH_INFO: `/v3/users/333e3b219d3b4ee391974a40a6420bce` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.891503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333e3b219d3b4ee391974a40a6420bce)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:18.893923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:18.903949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 784/1548] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:18.909730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:18.954839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc4091-fec0-4443-a6e3-72f862c9b34e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:18.972505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fef967-f1e5-4297-9a09-d1976b4152b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:18.973176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef967-f1e5-4297-9a09-d1976b4152b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:18.973458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef967-f1e5-4297-9a09-d1976b4152b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:18.973746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef967-f1e5-4297-9a09-d1976b4152b8 admin admin] PATH_INFO: `/v3/projects/28187924b4384680ab18e3692614931b/users/8d672a19f7a44742962951aa49cae348/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:18.992562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333e3b219d3b4ee391974a40a6420bce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:18.999378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:19.015898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333e3b219d3b4ee391974a40a6420bce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:19.030551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fef967-f1e5-4297-9a09-d1976b4152b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28187924b4384680ab18e3692614931b, user_id=8d672a19f7a44742962951aa49cae348, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:19.031564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333e3b219d3b4ee391974a40a6420bce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:19.032718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333e3b219d3b4ee391974a40a6420bce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:19.033354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fef967-f1e5-4297-9a09-d1976b4152b8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:19.072546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 785/1549] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:18 2022] PUT /identity/v3/projects/28187924b4384680ab18e3692614931b/users/8d672a19f7a44742962951aa49cae348/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:19.085215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.085435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.085716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:19.095532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-48735dc4-5bd3-464f-83a1-3e81ab3168a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333e3b219d3b4ee391974a40a6420bce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:19.112201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 765/1550] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:18 2022] DELETE /identity/v3/users/333e3b219d3b4ee391974a40a6420bce => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:19.117507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.117859 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.118176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:19.129795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] MFA Rules not processed for user `8d672a19f7a44742962951aa49cae348`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:19.131473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:19.158906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:19.161161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:19.239733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 786/1551] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:19.244517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:19.246377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:19.271844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 766/1552] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:19.323297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:19.325631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:19.382638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:19.443211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ea1f7-0581-4af9-b22a-ff63d7186c7a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:19.458667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:19.458897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.459143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.459411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:19.460221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:19.464731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb32a86-1c69-4021-931f-4884464ce287 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:19.464878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:19.471165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:19.472593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.473122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.473602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:19.490020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:19.492135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:19.506407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 767/1553] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:19.557253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 787/1554] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:19 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:19.559286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:19.575372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72371b2-b854-48ea-b825-8f2f8b520b9d service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:19.788649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:19.789276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.789564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.789846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:19.790541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:19.793927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:19.859354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:19.869155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 768/1555] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:19 2022] POST /identity/v3/users => generated 295 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:19.883348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:19.898195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:19.902792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:19.908230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9e9c-500e-4038-8ef1-d5b790b50c34 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:19.920971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:19.921208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.921403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.921646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:19.922369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:19.925331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:19.929590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f153f60-e82f-43b3-b438-b39d5d7f21ab admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:19.941015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:19.941681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.941972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.944037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] PATH_INFO: `/v3/users/c87f3711792b4387a365260a2d473373` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:19.945204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87f3711792b4387a365260a2d473373)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:19.947211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:19.955633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 788/1556] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:19.956538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:19.968273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aecbb-4e04-4881-91ea-4f344abf3a6d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:19.973525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:19.973714 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:19.973967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:19.974594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] PATH_INFO: `/v3/projects/1dbcf1596ef74d9ba46bac36e4012627/users/bde9a8e663054af0a49eb03357e809f1/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.011503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbcf1596ef74d9ba46bac36e4012627, user_id=bde9a8e663054af0a49eb03357e809f1, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:20.014324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:20.025445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87f3711792b4387a365260a2d473373'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.031467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 789/1557] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:19 2022] PUT /identity/v3/projects/1dbcf1596ef74d9ba46bac36e4012627/users/bde9a8e663054af0a49eb03357e809f1/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:20.037364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:20.040589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87f3711792b4387a365260a2d473373'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.051924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87f3711792b4387a365260a2d473373'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.052716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87f3711792b4387a365260a2d473373'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.088228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5ab05be2-2e29-4a8e-8841-e6877fa92f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87f3711792b4387a365260a2d473373'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.122142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 769/1558] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:19 2022] DELETE /identity/v3/users/c87f3711792b4387a365260a2d473373 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:20.126263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.126866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.127718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.142281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbce0-20e6-4d0d-8749-464e6912b417 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:20.165201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:20.167962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:20.256374 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:20.257010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.257290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.257648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.258262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:20.260063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:20.265909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 770/1559] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:20.266864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:20.268955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:20.286940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee7e96-2ef2-407c-b56c-63654cd0b420 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:20.287869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 790/1560] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:20.289191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:20.291486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:20.291667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:20.292291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.292572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.292846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] PATH_INFO: `/v3/projects/44f7f11a75994338970821fd7f5b350e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.293998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f7f11a75994338970821fd7f5b350e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:20.297848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:20.351617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:20.377524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977f1bb-8d69-40a3-8b29-fdaa0c7fe0b5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:20.402750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f7f11a75994338970821fd7f5b350e', 'request_id': 'req-9e64b621-b791-47dd-be46-ae5d3c9aa855'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.421201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f7f11a75994338970821fd7f5b350e', 'request_id': 'req-9e64b621-b791-47dd-be46-ae5d3c9aa855'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.452185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f7f11a75994338970821fd7f5b350e', 'request_id': 'req-9e64b621-b791-47dd-be46-ae5d3c9aa855'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.456587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:20.457252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.457532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.457809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.463372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:20.475500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] The token cache is being invalidate because project 44f7f11a75994338970821fd7f5b350e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:20.476686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.477785 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.483629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 771/1561] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:20 2022] DELETE /identity/v3/projects/44f7f11a75994338970821fd7f5b350e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:20.483629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:20.483629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:20.590724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64b621-b791-47dd-be46-ae5d3c9aa855 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:20.603536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:20.605373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:20.605858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aae061-07f1-4111-a1e5-99e16809a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:20.606564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aae061-07f1-4111-a1e5-99e16809a056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.606844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aae061-07f1-4111-a1e5-99e16809a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.607145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aae061-07f1-4111-a1e5-99e16809a056 admin admin] PATH_INFO: `/v3/projects/1dbcf1596ef74d9ba46bac36e4012627/users/bde9a8e663054af0a49eb03357e809f1/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.613525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aae061-07f1-4111-a1e5-99e16809a056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbcf1596ef74d9ba46bac36e4012627, user_id=bde9a8e663054af0a49eb03357e809f1, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:20.616233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aae061-07f1-4111-a1e5-99e16809a056 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:20.631897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 791/1562] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:20.632542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:20.644806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ade6-8ecb-4f73-8a13-deabb732d7e6 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:20.653801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 772/1563] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:20 2022] PUT /identity/v3/projects/1dbcf1596ef74d9ba46bac36e4012627/users/bde9a8e663054af0a49eb03357e809f1/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:20.655746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.655966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.656237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.698061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] MFA Rules not processed for user `bde9a8e663054af0a49eb03357e809f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:20.699662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:20.742720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:20.743458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.743753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.744051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] PATH_INFO: `/v3/users/94d561bedfe94792b14640dc29155599` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.745637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d561bedfe94792b14640dc29155599)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:20.749926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:20.814430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 773/1564] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:20.820325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d561bedfe94792b14640dc29155599'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.821482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:20.827845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:20.829280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:20.845189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d561bedfe94792b14640dc29155599'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.846480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d561bedfe94792b14640dc29155599'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.847231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d561bedfe94792b14640dc29155599'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.856258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d561bedfe94792b14640dc29155599'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:20.878230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 792/1565] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:20 2022] DELETE /identity/v3/users/94d561bedfe94792b14640dc29155599 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:20.897504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ffba8-d65b-4d8e-93c5-83688360425c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:20.941274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:20.975170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:20.978394 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:20.978773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:20.979095 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:20.990314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:20.993295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:20.994890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:21.124981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:21.127541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:21.146988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 774/1566] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:21.160404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882e2c-4043-4407-ade7-d236ba7c72df admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:21.174395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:21.176951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:21.177664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:21.178165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] PATH_INFO: `/v3/projects/bd9ea837561c4855a1c87bc2b7702c81` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:21.181393 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9ea837561c4855a1c87bc2b7702c81)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:21.187899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:21.310020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9ea837561c4855a1c87bc2b7702c81', 'request_id': 'req-59f57ae8-4f56-41a4-98f2-d52ee9283e15'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.323888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9ea837561c4855a1c87bc2b7702c81', 'request_id': 'req-59f57ae8-4f56-41a4-98f2-d52ee9283e15'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.335923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9ea837561c4855a1c87bc2b7702c81', 'request_id': 'req-59f57ae8-4f56-41a4-98f2-d52ee9283e15'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.358873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] The token cache is being invalidate because project bd9ea837561c4855a1c87bc2b7702c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:21.359170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.360085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.365735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 793/1567] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:20 2022] DELETE /identity/v3/projects/bd9ea837561c4855a1c87bc2b7702c81 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:21.366389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:21.383223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fbc38-ed05-4261-ae79-f591ed7e3c25 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:21.473947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:21.474831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:21.475143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:21.475491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] PATH_INFO: `/v3/users/17c7400c60174bc6be3eb89f7d979562` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:21.477510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c7400c60174bc6be3eb89f7d979562)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:21.480146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:21.545399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c7400c60174bc6be3eb89f7d979562'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.554300 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c7400c60174bc6be3eb89f7d979562'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.564689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c7400c60174bc6be3eb89f7d979562'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.565612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c7400c60174bc6be3eb89f7d979562'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.630690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:21.631966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-76b553f4-6866-4728-826d-b70599fabc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c7400c60174bc6be3eb89f7d979562'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.633246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:21.641538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 775/1568] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:21 2022] DELETE /identity/v3/users/17c7400c60174bc6be3eb89f7d979562 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:21.675890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f57ae8-4f56-41a4-98f2-d52ee9283e15 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:21.762158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:21.780358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:21.780822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:21.781056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:21.781486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] PATH_INFO: `/v3/projects/136baca44be8456d83668576a4c8842b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:21.785044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136baca44be8456d83668576a4c8842b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:21.787719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:21.820667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbceff-6b76-4c84-a128-8d450a2b23cc None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:21.820980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbceff-6b76-4c84-a128-8d450a2b23cc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:21.821287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbceff-6b76-4c84-a128-8d450a2b23cc None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:21.827411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 776/1569] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:06:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:06:21.840837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:21.842772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:21.843655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:21.862972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:21.866508 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136baca44be8456d83668576a4c8842b', 'request_id': 'req-37a175f3-fc04-4715-ad3a-a3c2707b6319'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.875812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136baca44be8456d83668576a4c8842b', 'request_id': 'req-37a175f3-fc04-4715-ad3a-a3c2707b6319'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.885558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136baca44be8456d83668576a4c8842b', 'request_id': 'req-37a175f3-fc04-4715-ad3a-a3c2707b6319'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.898957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:21.903077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] The token cache is being invalidate because project 136baca44be8456d83668576a4c8842b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:21.903077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.903788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-37a175f3-fc04-4715-ad3a-a3c2707b6319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:21.906367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 794/1570] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:21 2022] DELETE /identity/v3/projects/136baca44be8456d83668576a4c8842b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:21.906698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:21.911970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b853af0-1dd9-43a2-8268-c6d994335331 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:21.918324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b853af0-1dd9-43a2-8268-c6d994335331 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:21.919135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b853af0-1dd9-43a2-8268-c6d994335331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:21.950026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4b853af0-1dd9-43a2-8268-c6d994335331 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:21.952782 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4b853af0-1dd9-43a2-8268-c6d994335331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.066855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 777/1571] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:06:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:22.083769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.086255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.089800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 795/1572] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:22.097166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.097783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.098327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.102432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d90b45-cea4-4c4c-b0b0-1ba5f418e725 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.113733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.114788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.114788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.115094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.126426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.128347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.133763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:22.138231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.142421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 778/1573] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:22.175535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 796/1574] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:22.190315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.205205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d34cd-3925-4812-a83b-f7a0a5dec2a8 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.211199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.211918 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.212274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.212617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.213369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:22.213830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.216313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.220783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.222882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.234293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 779/1575] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:22.235319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.247403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696b24a-778d-4add-95fa-21b41a64a695 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.248238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5956caf-92fe-4205-b797-1ed722b68d9d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.253271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.253419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.253986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.254323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.254600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.255242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.255586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.255878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.256160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] PATH_INFO: `/v3/projects/8dc9a56f7b9a4850808a6e19ee675c5a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.257146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.257363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc9a56f7b9a4850808a6e19ee675c5a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.259306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.296640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 780/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:22.301102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.328506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc9a56f7b9a4850808a6e19ee675c5a', 'request_id': 'req-a381999f-94ad-4584-9662-4c865fc0f460'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:22.340932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc9a56f7b9a4850808a6e19ee675c5a', 'request_id': 'req-a381999f-94ad-4584-9662-4c865fc0f460'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:22.352595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc9a56f7b9a4850808a6e19ee675c5a', 'request_id': 'req-a381999f-94ad-4584-9662-4c865fc0f460'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:22.361143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:22.366640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] The token cache is being invalidate because project 8dc9a56f7b9a4850808a6e19ee675c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:22.367598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:22.369045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a381999f-94ad-4584-9662-4c865fc0f460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:22.374722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 797/1577] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:22 2022] DELETE /identity/v3/projects/8dc9a56f7b9a4850808a6e19ee675c5a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:22.376312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.377690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.378295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.402980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:22.405936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.421928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9e4be-975b-45da-8a6a-79bac53519f6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.486408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 798/1578] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:22.486408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.486408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.495319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:22.509093 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e712880-ed3e-4177-9dc6-5f5902a603da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.509721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e712880-ed3e-4177-9dc6-5f5902a603da admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.510008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e712880-ed3e-4177-9dc6-5f5902a603da admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.510320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e712880-ed3e-4177-9dc6-5f5902a603da admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.510965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e712880-ed3e-4177-9dc6-5f5902a603da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.512890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e712880-ed3e-4177-9dc6-5f5902a603da admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.537191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 781/1579] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:22.538864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.539315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.539713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.558192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517876-1c82-4fb1-8cc6-4a6a68fc6362 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.562493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:22.562961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.563573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.563689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.563845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.564360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.565976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.573367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 782/1580] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:22.574214 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.575487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.599413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b870a-ba6a-40f9-a11a-54f46897525a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.618816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.619681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.620057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.620340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.622488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.626462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.639765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 783/1581] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:22.640702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.651823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6f28b-079d-422e-a963-20083bdea3ec admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.658808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.659579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.659873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.660152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.660806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:22.661113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.662935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.669517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.671553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.679506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 784/1582] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:22.680704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.695756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cf498-0c21-44ec-89a2-0aa2322e0ddb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.700771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 799/1583] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:22.702593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.702784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.703593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.703973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.705618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.707040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.710180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.728921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9258725-6fd4-4829-9398-111a8b18d31f service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.740823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.741454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.741767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.742001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.742764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.744680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.746541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 785/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:22.751888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.770195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8133c8-270b-495a-8f9a-8dee8de4669d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.777671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.778740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.779898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.780179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] PATH_INFO: `/v3/projects/0d0b93334a4f46f58f9574ed690e1398/users/60f3c8da843f471b959960cc0fdb8f62/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.799357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 800/1585] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:22.799807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.801996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.804441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0b93334a4f46f58f9574ed690e1398, user_id=60f3c8da843f471b959960cc0fdb8f62, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.807349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.832475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 786/1586] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:22 2022] PUT /identity/v3/projects/0d0b93334a4f46f58f9574ed690e1398/users/60f3c8da843f471b959960cc0fdb8f62/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:22.833303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:22.854782 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:22.886957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4e63-a4b5-45ce-a6f9-cb0fbf62cc69 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.922420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc26a7-5de6-49b7-ba1f-68054f2885b9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:22.927196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0505223-01d0-42d2-8384-faa327de10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.927809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0505223-01d0-42d2-8384-faa327de10fd admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.928096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0505223-01d0-42d2-8384-faa327de10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.928374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0505223-01d0-42d2-8384-faa327de10fd admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.929011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0505223-01d0-42d2-8384-faa327de10fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:22.930994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0505223-01d0-42d2-8384-faa327de10fd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:22.948153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:22.948963 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.949438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.949788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:22.952103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:22.981450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 787/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:22.984147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60690b66-8a12-4cfe-ac44-ee9f612c5df1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:22.984630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60690b66-8a12-4cfe-ac44-ee9f612c5df1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:22.985108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60690b66-8a12-4cfe-ac44-ee9f612c5df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.024746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-60690b66-8a12-4cfe-ac44-ee9f612c5df1 None None] MFA Rules not processed for user `60f3c8da843f471b959960cc0fdb8f62`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:23.026436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-60690b66-8a12-4cfe-ac44-ee9f612c5df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:23.049168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.053454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.099670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 801/1588] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:23.101229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.140598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dc95c-73f6-4efe-b251-09302f05af70 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.158759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.159255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:23.159371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.159672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.159976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.160779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.162829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.180050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 788/1589] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:23.180183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 802/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:23.183211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.183334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60690b66-8a12-4cfe-ac44-ee9f612c5df1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.197476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60690b66-8a12-4cfe-ac44-ee9f612c5df1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.214757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f762ba1-6615-47f1-bf32-98ec05adba05 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.220801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.221264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.222267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.222570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.222745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.222901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.223556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.223882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.224706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.226736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.227789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.233819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.261749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 789/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:23.265381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.274865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 803/1592] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:23 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:23.279406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.288794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6864d6-0983-42ad-ba8d-7847f4d0323b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.406570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a719d-4bff-485b-b8bc-7ce4603d280a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.416413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.417362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.417752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.418324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.419308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.423362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.432135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17e572-755a-4e62-a805-008c23f16b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.432818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17e572-755a-4e62-a805-008c23f16b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.433100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17e572-755a-4e62-a805-008c23f16b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.433386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17e572-755a-4e62-a805-008c23f16b61 admin admin] PATH_INFO: `/v3/projects/6b80ca06ee98448cb0bfd63b1eacd85c/users/74c94536e4dd476bb8a4efba6e240f1f/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.435409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:23.466603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 804/1593] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:23 2022] POST /identity/v3/users => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:23.466603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.475185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17e572-755a-4e62-a805-008c23f16b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b80ca06ee98448cb0bfd63b1eacd85c, user_id=74c94536e4dd476bb8a4efba6e240f1f, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.482477 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17e572-755a-4e62-a805-008c23f16b61 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.490728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d7ac9-176b-436f-bb0d-b85587d982bd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.502383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 790/1594] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:23 2022] PUT /identity/v3/projects/6b80ca06ee98448cb0bfd63b1eacd85c/users/74c94536e4dd476bb8a4efba6e240f1f/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:23.507190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.508375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.508732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.509066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.509874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.511732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.514028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b07a-afc2-4330-8cae-64e90106d3de None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.515705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b07a-afc2-4330-8cae-64e90106d3de None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.516160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b07a-afc2-4330-8cae-64e90106d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.527020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 805/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:23.528690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.547215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862167-1d69-46c1-bbc6-fa6a88b88777 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.562362 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0309b07a-afc2-4330-8cae-64e90106d3de None None] MFA Rules not processed for user `74c94536e4dd476bb8a4efba6e240f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:23.563798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0309b07a-afc2-4330-8cae-64e90106d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:23.627767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.628433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.628713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.628988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] PATH_INFO: `/v3/projects/20ba404d6c7b41d487acd2b7b241047a/users/ede920ffc0844224a8d0a80d7807623b/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.645216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ba404d6c7b41d487acd2b7b241047a, user_id=ede920ffc0844224a8d0a80d7807623b, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.648521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.651028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 791/1596] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:23.656070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b07a-afc2-4330-8cae-64e90106d3de None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.665422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 806/1597] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:23 2022] PUT /identity/v3/projects/20ba404d6c7b41d487acd2b7b241047a/users/ede920ffc0844224a8d0a80d7807623b/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:23.669284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.672059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b07a-afc2-4330-8cae-64e90106d3de None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.741484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd8d7-a6b5-4758-be35-dec264ea6180 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.750043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.750861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.751080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.751359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.751740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.752145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.752950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.753153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.753558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.754375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.754899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.756752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.762834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:23.768294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 807/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:23.772808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.787077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe64734-0fee-46d3-9f20-d7c35e3d5022 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.793200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 792/1599] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:23 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:23.796979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.797177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c9a1-1a5c-4c79-b93d-9bfc7512b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.797988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c9a1-1a5c-4c79-b93d-9bfc7512b1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.798412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c9a1-1a5c-4c79-b93d-9bfc7512b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.798789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c9a1-1a5c-4c79-b93d-9bfc7512b1cf admin admin] PATH_INFO: `/v3/projects/20ba404d6c7b41d487acd2b7b241047a/users/ede920ffc0844224a8d0a80d7807623b/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.801215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c9a1-1a5c-4c79-b93d-9bfc7512b1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ba404d6c7b41d487acd2b7b241047a, user_id=ede920ffc0844224a8d0a80d7807623b, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.804417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c9a1-1a5c-4c79-b93d-9bfc7512b1cf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.822490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 808/1600] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:23 2022] PUT /identity/v3/projects/20ba404d6c7b41d487acd2b7b241047a/users/ede920ffc0844224a8d0a80d7807623b/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:23.842354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592108f3-5063-45c0-9c28-8a34764bdbc3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.842354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592108f3-5063-45c0-9c28-8a34764bdbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.842354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592108f3-5063-45c0-9c28-8a34764bdbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.867280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-592108f3-5063-45c0-9c28-8a34764bdbc3 None None] MFA Rules not processed for user `ede920ffc0844224a8d0a80d7807623b`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:23.868675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-592108f3-5063-45c0-9c28-8a34764bdbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:23.884139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7545e-1eb3-405e-a6eb-8c54db8cc0ea admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:23.906003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:23.950738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 809/1601] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:23.952290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:23.952919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:23.953203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:23.953480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:23.954157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:23.956167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:23.962313 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592108f3-5063-45c0-9c28-8a34764bdbc3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.982612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 793/1602] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:23 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:23.984122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:23.996345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886880f-d2ea-45f8-86dc-0c8d802522ea admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:24.001762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:24.002406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.002692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.002972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.003760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:24.005540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:24.016585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 794/1603] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:24.020704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:24.030617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592108f3-5063-45c0-9c28-8a34764bdbc3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:24.031409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431df05-c9fe-4279-a02c-916ccf3f0a39 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:24.034798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:24.035542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.035830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.036235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.037241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:24.037900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.038223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.038506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] PATH_INFO: `/v3/projects/962bb21c70be4c82ab171eafe8fc7045/users/66bb3632e81644c6b8360e8d0bbf76c4/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.047744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:24.049226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:24.058402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962bb21c70be4c82ab171eafe8fc7045, user_id=66bb3632e81644c6b8360e8d0bbf76c4, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:24.061908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:24.065984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 810/1604] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:24.079017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 795/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:24 2022] PUT /identity/v3/projects/962bb21c70be4c82ab171eafe8fc7045/users/66bb3632e81644c6b8360e8d0bbf76c4/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:24.083029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:24.094465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69d6f-5964-4be1-95d4-9d3d4aa07105 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:24.120699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:24.156454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:24.157066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.157347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.157618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.158312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:24.159922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:24.170558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 811/1606] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:24.174376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:24.174561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:24.180800 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d59dde-5f79-43d8-9ad5-fe1d96b78548 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:24.184111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece03c-e3fa-4b68-8470-392522b6ecef admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:24.184830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:24.185619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.186280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.186658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.189051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d0f0c-e34d-42a5-8a50-8df1012f94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:24.189709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0f0c-e34d-42a5-8a50-8df1012f94ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.189991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0f0c-e34d-42a5-8a50-8df1012f94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.190298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d0f0c-e34d-42a5-8a50-8df1012f94ef admin admin] PATH_INFO: `/v3/projects/962bb21c70be4c82ab171eafe8fc7045/users/66bb3632e81644c6b8360e8d0bbf76c4/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.192210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d0f0c-e34d-42a5-8a50-8df1012f94ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=962bb21c70be4c82ab171eafe8fc7045, user_id=66bb3632e81644c6b8360e8d0bbf76c4, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:24.194859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d0f0c-e34d-42a5-8a50-8df1012f94ef admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:24.206300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 812/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:24 2022] PUT /identity/v3/projects/962bb21c70be4c82ab171eafe8fc7045/users/66bb3632e81644c6b8360e8d0bbf76c4/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:24.223867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa6dbd-280b-4525-9884-bd00c83971ab None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.224163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa6dbd-280b-4525-9884-bd00c83971ab None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.224718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa6dbd-280b-4525-9884-bd00c83971ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.250811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:24.252227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:24.260766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6faa6dbd-280b-4525-9884-bd00c83971ab None None] MFA Rules not processed for user `66bb3632e81644c6b8360e8d0bbf76c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:24.262608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6faa6dbd-280b-4525-9884-bd00c83971ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:24.268804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 796/1608] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:24.332129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:24.411976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 813/1609] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:24.472526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:24.484783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0793-063c-4d7e-8efc-4753f461cece service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:24.551951 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead2d26-a511-4653-bbbe-fbb04a032491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:24.553974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2d26-a511-4653-bbbe-fbb04a032491 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:24.553974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2d26-a511-4653-bbbe-fbb04a032491 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:24.553974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead2d26-a511-4653-bbbe-fbb04a032491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:24.568159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead2d26-a511-4653-bbbe-fbb04a032491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:24.569661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead2d26-a511-4653-bbbe-fbb04a032491 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:24.581704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 797/1610] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:25.488405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa6dbd-280b-4525-9884-bd00c83971ab None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:25.552210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa6dbd-280b-4525-9884-bd00c83971ab None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:25.556741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:25.557370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:25.557650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:25.557924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] PATH_INFO: `/v3/users/74c94536e4dd476bb8a4efba6e240f1f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:25.559105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c94536e4dd476bb8a4efba6e240f1f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:25.561704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:25.609936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c94536e4dd476bb8a4efba6e240f1f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:25.623071 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c94536e4dd476bb8a4efba6e240f1f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:25.624068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c94536e4dd476bb8a4efba6e240f1f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:25.624765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c94536e4dd476bb8a4efba6e240f1f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:25.632221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c94536e4dd476bb8a4efba6e240f1f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:25.646542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 814/1611] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:25 2022] DELETE /identity/v3/users/74c94536e4dd476bb8a4efba6e240f1f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:25.651047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:25.651462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:25.651619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:25.672103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:25.673350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:25.738298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 798/1612] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:25.748270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:25.749730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:25.811406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791b77-7efa-4590-9f04-628b18fba746 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:25.815139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:25.815751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:25.816032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:25.816301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:25.827884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:25.829338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:25.841017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 815/1613] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:26.492755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:26.494608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:26.519214 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf03d-78d0-4236-b080-b8eeffe17dee None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:26.539376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:26.540377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:26.540976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:26.541427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] PATH_INFO: `/v3/projects/6b80ca06ee98448cb0bfd63b1eacd85c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:26.543701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b80ca06ee98448cb0bfd63b1eacd85c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:26.546066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:26.625764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:26.638420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b80ca06ee98448cb0bfd63b1eacd85c', 'request_id': 'req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.647136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b80ca06ee98448cb0bfd63b1eacd85c', 'request_id': 'req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.659808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b80ca06ee98448cb0bfd63b1eacd85c', 'request_id': 'req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.683860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] The token cache is being invalidate because project 6b80ca06ee98448cb0bfd63b1eacd85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:26.684431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.686277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.688445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 799/1614] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:26 2022] DELETE /identity/v3/projects/6b80ca06ee98448cb0bfd63b1eacd85c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:26.692995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:26.702365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:26.707809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d930a-e2ec-4bbb-804e-a29107d5f2d4 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:26.798047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:26.798837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:26.799635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:26.799922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] PATH_INFO: `/v3/users/66bb3632e81644c6b8360e8d0bbf76c4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:26.801355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66bb3632e81644c6b8360e8d0bbf76c4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:26.803819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:26.864077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66bb3632e81644c6b8360e8d0bbf76c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.905806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66bb3632e81644c6b8360e8d0bbf76c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.906592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66bb3632e81644c6b8360e8d0bbf76c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.907305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66bb3632e81644c6b8360e8d0bbf76c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.922404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66bb3632e81644c6b8360e8d0bbf76c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:26.957392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 816/1615] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:26 2022] DELETE /identity/v3/users/66bb3632e81644c6b8360e8d0bbf76c4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:27.572247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:27.573917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:27.614406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a730-7fad-41fd-8e3c-3e6b6ce5ba19 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:27.702298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:27.702298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:27.702298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:27.702298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] PATH_INFO: `/v3/projects/962bb21c70be4c82ab171eafe8fc7045` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:27.703111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=962bb21c70be4c82ab171eafe8fc7045)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:27.711691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:27.801915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:27.803547 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:27.831926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36ce95-b34d-47ba-999a-f43457573bd5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:27.837419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962bb21c70be4c82ab171eafe8fc7045', 'request_id': 'req-3cce2413-d9b3-4dcb-a566-050678eb1ed6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:27.852102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962bb21c70be4c82ab171eafe8fc7045', 'request_id': 'req-3cce2413-d9b3-4dcb-a566-050678eb1ed6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:27.864154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962bb21c70be4c82ab171eafe8fc7045', 'request_id': 'req-3cce2413-d9b3-4dcb-a566-050678eb1ed6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:27.884214 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] The token cache is being invalidate because project 962bb21c70be4c82ab171eafe8fc7045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:27.884964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:27.887306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3cce2413-d9b3-4dcb-a566-050678eb1ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:27.895210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 800/1616] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:27 2022] DELETE /identity/v3/projects/962bb21c70be4c82ab171eafe8fc7045 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:27.897234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f49f-e243-41d9-8d28-2bc9f49b6768 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:27.897880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f49f-e243-41d9-8d28-2bc9f49b6768 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:27.898339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f49f-e243-41d9-8d28-2bc9f49b6768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:27.927108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ec60f49f-e243-41d9-8d28-2bc9f49b6768 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:27.929059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ec60f49f-e243-41d9-8d28-2bc9f49b6768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:27.933988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:27.934916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:27.936301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:27.937013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] PATH_INFO: `/v3/users/8d672a19f7a44742962951aa49cae348` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:27.938834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d672a19f7a44742962951aa49cae348)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:27.942275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:27.951998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 801/1617] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:27.954363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896bd0-9b72-4222-9cb3-130caa86efc0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:27.954890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896bd0-9b72-4222-9cb3-130caa86efc0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:27.955351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896bd0-9b72-4222-9cb3-130caa86efc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:27.978039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:27.997158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d8896bd0-9b72-4222-9cb3-130caa86efc0 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:27.999558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d8896bd0-9b72-4222-9cb3-130caa86efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.011869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 802/1618] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:28.016794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896bd0-9b72-4222-9cb3-130caa86efc0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.026714 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d672a19f7a44742962951aa49cae348'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.039334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896bd0-9b72-4222-9cb3-130caa86efc0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.046034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.047102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.047592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.048106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.049554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:28.050248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.052869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.053124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d672a19f7a44742962951aa49cae348'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.053940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d672a19f7a44742962951aa49cae348'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.054818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d672a19f7a44742962951aa49cae348'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.079092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8260b5b4-f61e-427c-94b8-8178d8921a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d672a19f7a44742962951aa49cae348'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.085831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 803/1619] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:06:28.086770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.092725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.120027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 817/1620] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:27 2022] DELETE /identity/v3/users/8d672a19f7a44742962951aa49cae348 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:28.125751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baaa46-26f5-48e4-a029-98a2b4d0c46e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.126118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baaa46-26f5-48e4-a029-98a2b4d0c46e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.126400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baaa46-26f5-48e4-a029-98a2b4d0c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.131465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c6291-746b-405b-8f02-dff2f6a2ec4d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.156858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f1baaa46-26f5-48e4-a029-98a2b4d0c46e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:28.158583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f1baaa46-26f5-48e4-a029-98a2b4d0c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.171173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:28.211367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.211987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.212273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.212967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.213627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.216044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.247331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 818/1621] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:28.262254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 804/1622] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:28 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:28.262965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baaa46-26f5-48e4-a029-98a2b4d0c46e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.265487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.269691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.279372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baaa46-26f5-48e4-a029-98a2b4d0c46e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.356596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141d70-f0cc-4af0-a5f4-9306e7100bf8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.361104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.361834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.362010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.362330 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.400927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.401678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.401969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.402874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.403161 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.406512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.438370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 819/1623] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:28 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:28.443166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.449260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.451277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.458055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420775a-ff8e-465a-99cf-7cf0dd8190fb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.464392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 805/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:28.464551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.465074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.465358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.465658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.466877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.468749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.484447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 820/1625] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:28.488250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.504191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc4a7a-e928-4d41-81aa-d4d2929ad8ce service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.509565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.510212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.510498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.510776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.511432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.513032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.518628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.520485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.530280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 806/1626] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:28.534353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.537505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704ca1-9e0e-4fae-bc77-fd544ad23461 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.542408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.543118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.543351 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.543646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] PATH_INFO: `/v3/users/60f3c8da843f471b959960cc0fdb8f62` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.545313 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f3c8da843f471b959960cc0fdb8f62)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.547370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.556460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24bc10-14d8-4a36-ae6c-3d18975770a3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:28.565115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66711-7ca9-44e5-98d4-0d83aa3be07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:28.566212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66711-7ca9-44e5-98d4-0d83aa3be07e admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.566693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66711-7ca9-44e5-98d4-0d83aa3be07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.567163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66711-7ca9-44e5-98d4-0d83aa3be07e admin admin] PATH_INFO: `/v3/projects/67d47939a05b42258aabfb7f81c1beae/users/c3967cb99a65442f80a7cac8f70a3c40/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.574506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:28.607420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b66711-7ca9-44e5-98d4-0d83aa3be07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d47939a05b42258aabfb7f81c1beae, user_id=c3967cb99a65442f80a7cac8f70a3c40, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:28.610860 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b66711-7ca9-44e5-98d4-0d83aa3be07e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:28.636956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f3c8da843f471b959960cc0fdb8f62'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.643928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 807/1627] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:28 2022] PUT /identity/v3/projects/67d47939a05b42258aabfb7f81c1beae/users/c3967cb99a65442f80a7cac8f70a3c40/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:28.663817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.665345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.665345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.667071 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f3c8da843f471b959960cc0fdb8f62'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.668264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f3c8da843f471b959960cc0fdb8f62'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.669077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f3c8da843f471b959960cc0fdb8f62'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.681335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6dc93439-e51f-452a-a17f-1b730e63f91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f3c8da843f471b959960cc0fdb8f62'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:28.699228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 821/1628] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:28 2022] DELETE /identity/v3/users/60f3c8da843f471b959960cc0fdb8f62 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:28.707923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:28.708907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:28.709204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:28.719967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] MFA Rules not processed for user `c3967cb99a65442f80a7cac8f70a3c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:28.723065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.753237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:28.754599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.763321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:28.847540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 822/1629] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:28.854942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 808/1630] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:28.867721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.869073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:28.876948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:28.878836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:29.002996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d11ca-850f-4436-9f5b-b726ba3dbb7b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:29.007239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:29.008007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:29.008661 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:29.009041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:29.022252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:29.025089 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:29.037381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 823/1631] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:29.053674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd734d-4ebb-470f-b7e0-29aba63ef835 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:29.059030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:29.059769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:29.061342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:29.062315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:29.077866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:29.079770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:29.081061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:29.082640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:29.094944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 809/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:29.102475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91f1c6-c788-4332-b747-6b0f8d2afc25 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:29.109088 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:29.109842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:29.110273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:29.110653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] PATH_INFO: `/v3/projects/28187924b4384680ab18e3692614931b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:29.111982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28187924b4384680ab18e3692614931b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:29.116308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:29.177149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:29.214939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28187924b4384680ab18e3692614931b', 'request_id': 'req-780c670a-f606-4867-ab39-e45530a99b89'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.226407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28187924b4384680ab18e3692614931b', 'request_id': 'req-780c670a-f606-4867-ab39-e45530a99b89'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.252606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28187924b4384680ab18e3692614931b', 'request_id': 'req-780c670a-f606-4867-ab39-e45530a99b89'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.292920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] The token cache is being invalidate because project 28187924b4384680ab18e3692614931b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:29.293181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.296131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.302307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 824/1633] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:29 2022] DELETE /identity/v3/projects/28187924b4384680ab18e3692614931b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:29.306805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:29.335833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca70bfd-1fa5-4b98-a0ff-06ac6cab9c6c service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:29.554125 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:29.554797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:29.555673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:29.555673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] PATH_INFO: `/v3/users/bde9a8e663054af0a49eb03357e809f1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:29.560574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde9a8e663054af0a49eb03357e809f1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:29.567220 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:29.679227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde9a8e663054af0a49eb03357e809f1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.700504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde9a8e663054af0a49eb03357e809f1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.719348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde9a8e663054af0a49eb03357e809f1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.721464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde9a8e663054af0a49eb03357e809f1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.762466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:29.809596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde9a8e663054af0a49eb03357e809f1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:29.835050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 810/1634] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:29 2022] DELETE /identity/v3/users/bde9a8e663054af0a49eb03357e809f1 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:30.308396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:30.311263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:30.330784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c670a-f606-4867-ab39-e45530a99b89 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:30.421139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:30.421790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:30.422167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:30.422447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] PATH_INFO: `/v3/projects/0d0b93334a4f46f58f9574ed690e1398` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:30.424210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0b93334a4f46f58f9574ed690e1398)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:30.426481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:30.512124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0b93334a4f46f58f9574ed690e1398', 'request_id': 'req-edec9fdf-f110-4631-b061-cdea054153b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.521093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0b93334a4f46f58f9574ed690e1398', 'request_id': 'req-edec9fdf-f110-4631-b061-cdea054153b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.533366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0b93334a4f46f58f9574ed690e1398', 'request_id': 'req-edec9fdf-f110-4631-b061-cdea054153b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.562770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] The token cache is being invalidate because project 0d0b93334a4f46f58f9574ed690e1398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:30.563780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.564868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.569809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 825/1635] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:30 2022] DELETE /identity/v3/projects/0d0b93334a4f46f58f9574ed690e1398 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:30.571501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:30.573711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:30.598497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d417-ab11-4b62-97e0-149312f7e9d2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:30.658542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:30.660152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:30.748763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:30.770308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec9fdf-f110-4631-b061-cdea054153b7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:30.775655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:30.776312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:30.776704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:30.776986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] PATH_INFO: `/v3/projects/1dbcf1596ef74d9ba46bac36e4012627` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:30.778190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dbcf1596ef74d9ba46bac36e4012627)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:30.780728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:30.789777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:30.790630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:30.791145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:30.791685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] PATH_INFO: `/v3/users/ede920ffc0844224a8d0a80d7807623b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:30.794219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede920ffc0844224a8d0a80d7807623b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:30.797353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:30.883730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dbcf1596ef74d9ba46bac36e4012627', 'request_id': 'req-00465a3f-e226-4493-b63e-d930a6ffcb8e'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.894059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dbcf1596ef74d9ba46bac36e4012627', 'request_id': 'req-00465a3f-e226-4493-b63e-d930a6ffcb8e'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.907928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dbcf1596ef74d9ba46bac36e4012627', 'request_id': 'req-00465a3f-e226-4493-b63e-d930a6ffcb8e'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.924565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] The token cache is being invalidate because project 1dbcf1596ef74d9ba46bac36e4012627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:30.925016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.925684 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00465a3f-e226-4493-b63e-d930a6ffcb8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.928511 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede920ffc0844224a8d0a80d7807623b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.931384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 826/1636] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:30 2022] DELETE /identity/v3/projects/1dbcf1596ef74d9ba46bac36e4012627 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:30.934279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f11f-b626-4c87-8672-166df6dda0e4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:30.934808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f11f-b626-4c87-8672-166df6dda0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:30.936162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f11f-b626-4c87-8672-166df6dda0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:30.944472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede920ffc0844224a8d0a80d7807623b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.959392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede920ffc0844224a8d0a80d7807623b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.960123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede920ffc0844224a8d0a80d7807623b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:30.977996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4fa9f11f-b626-4c87-8672-166df6dda0e4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:30.979343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4fa9f11f-b626-4c87-8672-166df6dda0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:30.986602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-34263351-8ee3-44c3-954e-81f686f40b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede920ffc0844224a8d0a80d7807623b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:31.006418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 811/1637] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:30 2022] DELETE /identity/v3/users/ede920ffc0844224a8d0a80d7807623b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:31.120409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 827/1638] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:31.130841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0d7f-2b64-4e2c-a324-b2ee36743050 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.131131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0d7f-2b64-4e2c-a324-b2ee36743050 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.131431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0d7f-2b64-4e2c-a324-b2ee36743050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.167846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0d6e0d7f-2b64-4e2c-a324-b2ee36743050 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:31.170413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0d6e0d7f-2b64-4e2c-a324-b2ee36743050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:31.272989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 812/1639] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:31.274211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f11f-b626-4c87-8672-166df6dda0e4 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:31.287900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f11f-b626-4c87-8672-166df6dda0e4 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:31.324268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:31.325273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.325775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.326900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.328049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:31.328365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:31.330630 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:31.350234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 828/1640] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:31.351808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0d7f-2b64-4e2c-a324-b2ee36743050 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:31.359563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:31.370712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0d7f-2b64-4e2c-a324-b2ee36743050 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:31.380129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:31.381395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.382722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.383927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.385825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:31.388751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:31.499452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 813/1641] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:31 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:31.502525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:31.523939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457f97-8be8-4b45-9650-302cd674236d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:31.676645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:31.677471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.677995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.678359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.679068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:31.681043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:31.713454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:31.740289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 829/1642] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:31 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:31.745005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:31.759670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2277a2-bda4-4766-8ed4-e4586355ff84 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:31.769603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:31.770545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.771002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.771469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.772581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:31.774662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:31.791563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 814/1643] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:31.796910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:31.803581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:31.806818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:31.808768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e124c8-b008-4126-9a02-e47e7b6a93a4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:31.814938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:31.815550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.815828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.816099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.816886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:31.818839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:31.831686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602c5b-d799-49b9-b829-689c09809fc1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:31.838162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 830/1644] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:31.839659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:31.844030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:31.848262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.848853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.849325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] PATH_INFO: `/v3/projects/20ba404d6c7b41d487acd2b7b241047a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.850805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ba404d6c7b41d487acd2b7b241047a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:31.861995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10619f-a4ef-467a-8fec-b18d7fdd9891 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:31.865735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:31.867188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba5313-73a1-433f-89bf-fac5d3e3eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:31.867995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba5313-73a1-433f-89bf-fac5d3e3eae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.868278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba5313-73a1-433f-89bf-fac5d3e3eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.868550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba5313-73a1-433f-89bf-fac5d3e3eae0 admin admin] PATH_INFO: `/v3/projects/cfa4c5f549e143e9a40d1043b50a2cd2/users/1eead99a1b524708a1623a08266753d6/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.888117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba5313-73a1-433f-89bf-fac5d3e3eae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa4c5f549e143e9a40d1043b50a2cd2, user_id=1eead99a1b524708a1623a08266753d6, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:31.891994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba5313-73a1-433f-89bf-fac5d3e3eae0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:31.913247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 831/1645] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:31 2022] PUT /identity/v3/projects/cfa4c5f549e143e9a40d1043b50a2cd2/users/1eead99a1b524708a1623a08266753d6/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:31.929263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:31.929263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:31.929921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:31.974939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] MFA Rules not processed for user `1eead99a1b524708a1623a08266753d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:31.979130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:31.994351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ba404d6c7b41d487acd2b7b241047a', 'request_id': 'req-727ecec3-29f1-4f15-b06b-81d1749579ba'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:32.007086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ba404d6c7b41d487acd2b7b241047a', 'request_id': 'req-727ecec3-29f1-4f15-b06b-81d1749579ba'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:32.024791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ba404d6c7b41d487acd2b7b241047a', 'request_id': 'req-727ecec3-29f1-4f15-b06b-81d1749579ba'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:32.040936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] The token cache is being invalidate because project 20ba404d6c7b41d487acd2b7b241047a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:32.041293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:32.042046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-727ecec3-29f1-4f15-b06b-81d1749579ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:32.047172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 815/1646] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:31 2022] DELETE /identity/v3/projects/20ba404d6c7b41d487acd2b7b241047a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:32.052208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703aed-8bdf-46bb-a70c-1a239e043cf9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.052576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703aed-8bdf-46bb-a70c-1a239e043cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.053085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703aed-8bdf-46bb-a70c-1a239e043cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.082872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-59703aed-8bdf-46bb-a70c-1a239e043cf9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:32.084179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 832/1647] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:32.087728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-59703aed-8bdf-46bb-a70c-1a239e043cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:32.095041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.101870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:32.183838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 816/1648] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:32.190179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010e62-f70a-4757-8fb0-020645149e21 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.190515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010e62-f70a-4757-8fb0-020645149e21 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.190795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010e62-f70a-4757-8fb0-020645149e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.235397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e6010e62-f70a-4757-8fb0-020645149e21 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:32.236622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e6010e62-f70a-4757-8fb0-020645149e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:32.255572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 817/1649] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:32.260131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6010e62-f70a-4757-8fb0-020645149e21 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.266919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a3624-5fa8-46fd-a6d0-003f020b05b0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.276851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6010e62-f70a-4757-8fb0-020645149e21 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.278155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.279525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.279814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.280078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.280720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.283548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.291371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.291980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.292262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.292535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.293660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:32.293934 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.295607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.351097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 833/1650] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:32 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:32.352050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.352491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 818/1651] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:32.359140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.399471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158f536-32a2-4083-883d-84c7c921ee4b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.414408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:32.448857 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313199f-7740-477f-b1a6-5d35a4f8c136 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.457350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.458194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.458594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.458965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.459891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.464672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.498452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:32.510542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 834/1652] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:32 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:32.522337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.553667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae88370-c8f0-4bda-9e08-bb8ae0257c84 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.562818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.563645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.564919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.565529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.565819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.566446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.566960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.568671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.569140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.569489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.571101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.573065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.597932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 835/1653] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:32.599034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.635028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3922-a86d-440b-a083-8665bb1efa4e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.648213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.652555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 819/1654] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:32 2022] POST /identity/v3/projects => generated 409 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:32.655678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.656117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.656413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.656697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] PATH_INFO: `/v3/projects/73bad9faf2cd41d79ac77c484c7625a7/users/cc4c4ffccf2f4f07867eab5f29373e6f/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.690263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bad9faf2cd41d79ac77c484c7625a7, user_id=cc4c4ffccf2f4f07867eab5f29373e6f, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.694271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.721272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 836/1655] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:32 2022] PUT /identity/v3/projects/73bad9faf2cd41d79ac77c484c7625a7/users/cc4c4ffccf2f4f07867eab5f29373e6f/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:32.725619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.814613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e949d8-72ff-4388-ac09-a896810cfe08 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.849865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e858408-ee1c-40ee-bb47-3f42560666c6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.860995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.862108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.862547 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.866130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.866829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.868637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.882585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 837/1656] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:32.886954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.897870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.898517 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.898798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.899070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.899713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.902115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.904534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3cde5-7003-4fcd-b6f2-90443c5bad32 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.911483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b30b-4753-43ae-8043-52dd040aa4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:32.912671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b30b-4753-43ae-8043-52dd040aa4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.913600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b30b-4753-43ae-8043-52dd040aa4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.914379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b30b-4753-43ae-8043-52dd040aa4ec admin admin] PATH_INFO: `/v3/projects/73bad9faf2cd41d79ac77c484c7625a7/users/cc4c4ffccf2f4f07867eab5f29373e6f/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.916816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b30b-4753-43ae-8043-52dd040aa4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bad9faf2cd41d79ac77c484c7625a7, user_id=cc4c4ffccf2f4f07867eab5f29373e6f, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:32.919982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b30b-4753-43ae-8043-52dd040aa4ec admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:32.931507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 820/1657] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:32 2022] POST /identity/v3/users => generated 305 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:32.937681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:32.945990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 838/1658] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:32 2022] PUT /identity/v3/projects/73bad9faf2cd41d79ac77c484c7625a7/users/cc4c4ffccf2f4f07867eab5f29373e6f/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:32.956499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dfe2a-06e6-4bde-a300-7f5382d859e7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:32.957893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:32.958436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:32.958664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:32.995444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] MFA Rules not processed for user `cc4c4ffccf2f4f07867eab5f29373e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:32.997108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:33.020169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:33.030038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.031008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.031443 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.031962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.033966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.036198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.048430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 821/1659] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:33.055049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.067975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cfda7-fdb1-4f09-8ca7-8714756a4f17 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.073382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.074252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.074682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.075267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.076975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.078960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.095932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 822/1660] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:33.097055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.100553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:33.111932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e91f7-b96b-4281-b9f3-52f1b89a5dcf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.113605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 839/1661] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:33.122354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ca24c-aa76-4658-9772-d9abace22a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.123452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca24c-aa76-4658-9772-d9abace22a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.123813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca24c-aa76-4658-9772-d9abace22a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.124217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ca24c-aa76-4658-9772-d9abace22a8d admin admin] PATH_INFO: `/v3/projects/5c941528e0b04161ab78e4c2a90fb965/users/94fe86eb85c64d6d9789bc9f83238372/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.126828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.128970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:33.151210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ca24c-aa76-4658-9772-d9abace22a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c941528e0b04161ab78e4c2a90fb965, user_id=94fe86eb85c64d6d9789bc9f83238372, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.154839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ca24c-aa76-4658-9772-d9abace22a8d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.174192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 823/1662] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:33 2022] PUT /identity/v3/projects/5c941528e0b04161ab78e4c2a90fb965/users/94fe86eb85c64d6d9789bc9f83238372/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:33.185515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234c4c-026d-41d7-add1-8a460041ff78 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.186063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234c4c-026d-41d7-add1-8a460041ff78 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.186590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234c4c-026d-41d7-add1-8a460041ff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.210179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d2445-35ad-4902-9fae-479358b1368f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.225177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-64234c4c-026d-41d7-add1-8a460041ff78 None None] MFA Rules not processed for user `94fe86eb85c64d6d9789bc9f83238372`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:33.226489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-64234c4c-026d-41d7-add1-8a460041ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:33.276155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.277200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.277690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.278233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.309831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 824/1663] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:33 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:33.311728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234c4c-026d-41d7-add1-8a460041ff78 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.362591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.364253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.377584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 840/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:33.397556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234c4c-026d-41d7-add1-8a460041ff78 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.403302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.404076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.404652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.405013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.406010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.408153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.465542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 825/1665] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:33 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:33.465735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.478955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeb49c-70d3-4750-9959-505fdbe5bbd1 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.489982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.492002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:33.573107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:33.585619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.587006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.587150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.587378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.588192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.593666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.622947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:33.646363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 841/1666] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:33 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:33.649716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.653101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acae7a-2d56-434a-8bfd-7d71239d9871 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.667184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91c60-80bb-48e2-b4e4-1e73e42bd6ed admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.671857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.671857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.671857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.671857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] PATH_INFO: `/v3/users/c3967cb99a65442f80a7cac8f70a3c40` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.673133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3967cb99a65442f80a7cac8f70a3c40)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.675119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.682529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.683111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.683394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.683671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.684322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.689408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.720308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 842/1667] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:33.725320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.754527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d49058-41a0-4668-9a8b-28efd913fb29 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:33.762112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3967cb99a65442f80a7cac8f70a3c40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:33.771482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:33.772086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3967cb99a65442f80a7cac8f70a3c40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:33.772207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.772434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.772708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] PATH_INFO: `/v3/projects/b2a490b079ad42a0b1f9b7ebd47c61e1/users/5fd76cf503bb4bd781ea608a87db795c/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.783451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3967cb99a65442f80a7cac8f70a3c40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:33.784402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3967cb99a65442f80a7cac8f70a3c40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:33.803011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a490b079ad42a0b1f9b7ebd47c61e1, user_id=5fd76cf503bb4bd781ea608a87db795c, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:33.805720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:33.817533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b2064adc-4d35-4946-8e6d-0c6f0fe8625c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3967cb99a65442f80a7cac8f70a3c40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:33.840429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 843/1668] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:33 2022] PUT /identity/v3/projects/b2a490b079ad42a0b1f9b7ebd47c61e1/users/5fd76cf503bb4bd781ea608a87db795c/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:33.844334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:33.846802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:33.852219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 826/1669] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:33 2022] DELETE /identity/v3/users/c3967cb99a65442f80a7cac8f70a3c40 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:33.861452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:33.861965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:33.863650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:33.908677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:33.912046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:34.037565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d4652-fda9-4207-8d60-ae52065015f7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.089500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 827/1670] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:34.090458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:34.092616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:34.131771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.132830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.133675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.134280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.136286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.138836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.176745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 844/1671] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:34.180131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:34.180131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:34.196097 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:34.224437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29524e0-a687-424f-9eb0-3b6b24809cff None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.231590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4c4ffccf2f4f07867eab5f29373e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73bad9faf2cd41d79ac77c484c7625a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.232930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.233355 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.234477 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.235582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:34.235993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.238036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.273898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 828/1672] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:34.274871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:34.288547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7a5a-59e9-47fa-b441-b50076301ce1 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.306442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.307121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.307404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.307684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] PATH_INFO: `/v3/projects/b2a490b079ad42a0b1f9b7ebd47c61e1/users/5fd76cf503bb4bd781ea608a87db795c/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.309650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a490b079ad42a0b1f9b7ebd47c61e1, user_id=5fd76cf503bb4bd781ea608a87db795c, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.312685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.316420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b53ca-f7d5-43c9-9d04-ddb5281af302 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.337560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 829/1673] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:34 2022] PUT /identity/v3/projects/b2a490b079ad42a0b1f9b7ebd47c61e1/users/5fd76cf503bb4bd781ea608a87db795c/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:34.340758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:34.361771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:34.424094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.424772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.425034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.425313 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.434124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc046e-6fa1-4c31-b78d-31268fdb562e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.440599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e57e83-8ecb-4515-93a8-c98528ae60d2 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4c4ffccf2f4f07867eab5f29373e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73bad9faf2cd41d79ac77c484c7625a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.441339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57e83-8ecb-4515-93a8-c98528ae60d2 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.441812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57e83-8ecb-4515-93a8-c98528ae60d2 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.442199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57e83-8ecb-4515-93a8-c98528ae60d2 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.442920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e57e83-8ecb-4515-93a8-c98528ae60d2 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.445065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e57e83-8ecb-4515-93a8-c98528ae60d2 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.484048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 830/1674] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:34 2022] POST /identity/v3/projects => generated 354 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:34.484048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee4624-14f6-4c7c-9ea8-3a6c9a263df9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.484048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee4624-14f6-4c7c-9ea8-3a6c9a263df9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.484048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee4624-14f6-4c7c-9ea8-3a6c9a263df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.508422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.510767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.524538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-10ee4624-14f6-4c7c-9ea8-3a6c9a263df9 None None] MFA Rules not processed for user `5fd76cf503bb4bd781ea608a87db795c`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:34.525874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-10ee4624-14f6-4c7c-9ea8-3a6c9a263df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:34.529941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 845/1675] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:34.532249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:34.549856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba6876-4b49-4f53-8979-64fd356b548b service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.637484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4c4ffccf2f4f07867eab5f29373e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73bad9faf2cd41d79ac77c484c7625a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.639567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.640164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.640733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.642338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:34.643033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.645156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.666983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 846/1676] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:34.708554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 831/1677] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:34.716870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:34.718643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:34.757077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee4624-14f6-4c7c-9ea8-3a6c9a263df9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:34.771829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee4624-14f6-4c7c-9ea8-3a6c9a263df9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.783621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4c4ffccf2f4f07867eab5f29373e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73bad9faf2cd41d79ac77c484c7625a7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.784279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.784564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.784839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] PATH_INFO: `/v3/projects/396ba8797ee241c6bfdd3b6d6e7083a4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.787851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorizing `identity:delete_project(project_id=396ba8797ee241c6bfdd3b6d6e7083a4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.789792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.839224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092434e-7eb5-41ae-a409-85eb6f231754 tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:34.844911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:34.846377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:34.847169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:34.847702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:34.857622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:34.862025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:34.863771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:34.875163 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396ba8797ee241c6bfdd3b6d6e7083a4', 'request_id': 'req-e2a96f67-67dd-441d-b1b6-2a625712c51f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:34.878985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 847/1678] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:34.882962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396ba8797ee241c6bfdd3b6d6e7083a4', 'request_id': 'req-e2a96f67-67dd-441d-b1b6-2a625712c51f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:34.894536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396ba8797ee241c6bfdd3b6d6e7083a4', 'request_id': 'req-e2a96f67-67dd-441d-b1b6-2a625712c51f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:34.907926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] The token cache is being invalidate because project 396ba8797ee241c6bfdd3b6d6e7083a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:34.908228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:34.908922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:34.914895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 832/1679] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:34 2022] DELETE /identity/v3/projects/396ba8797ee241c6bfdd3b6d6e7083a4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:35.120844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:35.122363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:35.132497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:35.137045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a747d4d-c269-4602-a5e4-83ad810fe49f service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:35.230406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:35.233110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:35.275055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:35.276859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:35.277866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:35.279126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:35.282416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:35.358282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96f67-67dd-441d-b1b6-2a625712c51f tempest-VolumeQuotaClassesTest-885280349 tempest-VolumeQuotaClassesTest-885280349-project-admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:35.363923 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:35.364721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:35.365134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:35.365562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] PATH_INFO: `/v3/users/1eead99a1b524708a1623a08266753d6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:35.367697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eead99a1b524708a1623a08266753d6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:35.369852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:35.462901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:35.467042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:35.492096 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 848/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:35 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:35.493182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:35.494609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:35.505169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eead99a1b524708a1623a08266753d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.527784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4930df2-fb52-44c2-b77e-5abac6a967fa service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:35.529592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eead99a1b524708a1623a08266753d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.541551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:35.542333 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:35.542619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:35.543566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] PATH_INFO: `/v3/projects/67d47939a05b42258aabfb7f81c1beae` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:35.546366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d47939a05b42258aabfb7f81c1beae)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:35.546946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eead99a1b524708a1623a08266753d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.547965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eead99a1b524708a1623a08266753d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.551242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:35.590932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-413ca13d-9b9f-42a8-8f05-4f2df4791448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eead99a1b524708a1623a08266753d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.627360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 833/1681] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:35 2022] DELETE /identity/v3/users/1eead99a1b524708a1623a08266753d6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:35.632765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:35.636288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:35.636826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:35.676300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d47939a05b42258aabfb7f81c1beae', 'request_id': 'req-df9014bf-d333-4edb-8147-a790e7bcb591'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.693928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d47939a05b42258aabfb7f81c1beae', 'request_id': 'req-df9014bf-d333-4edb-8147-a790e7bcb591'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.704458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:35.707987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:35.719416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d47939a05b42258aabfb7f81c1beae', 'request_id': 'req-df9014bf-d333-4edb-8147-a790e7bcb591'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.750762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] The token cache is being invalidate because project 67d47939a05b42258aabfb7f81c1beae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:35.751336 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.752665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-df9014bf-d333-4edb-8147-a790e7bcb591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:35.759989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 849/1682] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:35 2022] DELETE /identity/v3/projects/67d47939a05b42258aabfb7f81c1beae => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:35.762175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a94102-7168-42f3-92b7-31ce51bbc046 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:35.763330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a94102-7168-42f3-92b7-31ce51bbc046 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:35.763778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a94102-7168-42f3-92b7-31ce51bbc046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:35.792544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f7a94102-7168-42f3-92b7-31ce51bbc046 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:35.794700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f7a94102-7168-42f3-92b7-31ce51bbc046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:35.834319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:35.872598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:35.886263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 834/1683] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:35.909197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:35.910686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:35.923327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 850/1684] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:35.931551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db722-c688-4825-8ddd-8fa7abb5969f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:35.932382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db722-c688-4825-8ddd-8fa7abb5969f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:35.933117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db722-c688-4825-8ddd-8fa7abb5969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.007258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9e0db722-c688-4825-8ddd-8fa7abb5969f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:36.009122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9e0db722-c688-4825-8ddd-8fa7abb5969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:36.027945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 851/1685] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:36.029083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db722-c688-4825-8ddd-8fa7abb5969f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.051548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db722-c688-4825-8ddd-8fa7abb5969f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.061610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f76802-d6a8-4c29-b472-8681001c0962 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.061817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.062235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.062517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.062799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.064871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:36.065114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.066837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.069062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.071696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.072407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.072407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.112312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.114978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.121357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 852/1686] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:36.126754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.142943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 835/1687] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:36.145967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a0c78-e40f-4f9e-a259-1b811950d818 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.157276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.160058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.160389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.160679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.161539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.165158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.209145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 853/1688] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:36 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:36.213318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.224974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe7c56-e26b-43e0-8619-9063bb3ad812 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.348047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.349977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.350520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.351162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.352173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.356323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.389344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 836/1689] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:36 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:36.394229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.411504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111e74-af51-472b-9a5e-b61e2e5231a7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.418820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.420537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.421154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.421580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.422970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.425175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.442898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 854/1690] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:36.446644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.458451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bc527-d7cd-495a-bfc3-8a6d576d56f8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.467473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2feab7a-cbcd-4d02-8789-5d22add95b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.468164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feab7a-cbcd-4d02-8789-5d22add95b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.468541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feab7a-cbcd-4d02-8789-5d22add95b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.468933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2feab7a-cbcd-4d02-8789-5d22add95b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.469684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2feab7a-cbcd-4d02-8789-5d22add95b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.473153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2feab7a-cbcd-4d02-8789-5d22add95b18 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.484754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 837/1691] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:36.488798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.501173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450871-a46a-4bf4-863a-aebb2f6fb833 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.509558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.510519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.512265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.512651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] PATH_INFO: `/v3/projects/b77c6be6ed5b4da0a95a7de2bdd1bb41/users/7fed1b4c6d8542b8b4752054c115b7b3/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.534468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77c6be6ed5b4da0a95a7de2bdd1bb41, user_id=7fed1b4c6d8542b8b4752054c115b7b3, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.539484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.557650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 855/1692] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:36 2022] PUT /identity/v3/projects/b77c6be6ed5b4da0a95a7de2bdd1bb41/users/7fed1b4c6d8542b8b4752054c115b7b3/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:36.569733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.570072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.570319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.600744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] MFA Rules not processed for user `7fed1b4c6d8542b8b4752054c115b7b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:36.601980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:36.648287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.651013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:36.708553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:36.722957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 838/1693] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:36.730664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.732238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:36.752339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2a1a9-f76d-4dda-8e2e-f3d50e760a49 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.758282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.758916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.759196 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.759466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] PATH_INFO: `/v3/projects/cfa4c5f549e143e9a40d1043b50a2cd2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.760968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa4c5f549e143e9a40d1043b50a2cd2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.764187 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.812911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb545bc0-e634-4b33-9bf3-31602422c851 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.818557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa4c5f549e143e9a40d1043b50a2cd2', 'request_id': 'req-f94fb49e-0f75-4c8a-9604-f803738eea1b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.826587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa4c5f549e143e9a40d1043b50a2cd2', 'request_id': 'req-f94fb49e-0f75-4c8a-9604-f803738eea1b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.836302 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa4c5f549e143e9a40d1043b50a2cd2', 'request_id': 'req-f94fb49e-0f75-4c8a-9604-f803738eea1b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.846672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:36.861611 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] The token cache is being invalidate because project cfa4c5f549e143e9a40d1043b50a2cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:36.861916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.862722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.867906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 856/1694] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:36 2022] DELETE /identity/v3/projects/cfa4c5f549e143e9a40d1043b50a2cd2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:36.867906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.875982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:36.883264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.883981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.884357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.884707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] PATH_INFO: `/v3/users/61e0ec0e75f94bc5af7d4cdc37aad651` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.886126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e0ec0e75f94bc5af7d4cdc37aad651)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:36.889017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:36.945941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb49e-0f75-4c8a-9604-f803738eea1b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:36.946806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e0ec0e75f94bc5af7d4cdc37aad651'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.949652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4b6ae-e8e1-4763-827e-6c149b065e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:36.950343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4b6ae-e8e1-4763-827e-6c149b065e5d service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:36.951362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4b6ae-e8e1-4763-827e-6c149b065e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:36.951572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4b6ae-e8e1-4763-827e-6c149b065e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:36.953437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-06b4b6ae-e8e1-4763-827e-6c149b065e5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:36.959018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e0ec0e75f94bc5af7d4cdc37aad651'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.969583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e0ec0e75f94bc5af7d4cdc37aad651'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.970376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e0ec0e75f94bc5af7d4cdc37aad651'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.983006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e0ec0e75f94bc5af7d4cdc37aad651'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:36.991625 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 839/1695] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:36 2022] DELETE /identity/v3/users/61e0ec0e75f94bc5af7d4cdc37aad651 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:36.992523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:36.995490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:37.024293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4b6ae-e8e1-4763-827e-6c149b065e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:37.025756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4b6ae-e8e1-4763-827e-6c149b065e5d service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:37.026493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:37.038510 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 857/1696] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:37.039901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:37.040392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:37.040724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:37.073339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e0a81-1001-4644-9a09-bd2f591533c2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:37.078683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:37.079279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:37.079562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:37.079838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] PATH_INFO: `/v3/users/cc4c4ffccf2f4f07867eab5f29373e6f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:37.081094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4c4ffccf2f4f07867eab5f29373e6f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:37.091706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:37.166157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4c4ffccf2f4f07867eab5f29373e6f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.175069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4c4ffccf2f4f07867eab5f29373e6f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.194312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4c4ffccf2f4f07867eab5f29373e6f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.195141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4c4ffccf2f4f07867eab5f29373e6f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.220835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4c4ffccf2f4f07867eab5f29373e6f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.223391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:37.224678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:37.232357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 840/1697] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:36 2022] DELETE /identity/v3/users/cc4c4ffccf2f4f07867eab5f29373e6f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:37.239918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 858/1698] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:37.251115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:37.253601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:37.367879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018484e-26ca-4dab-9aa6-ec09434ebff3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:37.394284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bc1c8-1b25-468a-b932-49581d5cb0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:37.395100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bc1c8-1b25-468a-b932-49581d5cb0cc service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:37.395413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bc1c8-1b25-468a-b932-49581d5cb0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:37.395729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bc1c8-1b25-468a-b932-49581d5cb0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:37.512251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:37.532495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bc1c8-1b25-468a-b932-49581d5cb0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:37.534301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bc1c8-1b25-468a-b932-49581d5cb0cc service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:37.551133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 841/1699] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:37.703075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:37.705079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:37.720251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2587d6-23bb-4f58-90b0-1d4e6604f314 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:37.727988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:37.728918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:37.729193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:37.729500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] PATH_INFO: `/v3/projects/73bad9faf2cd41d79ac77c484c7625a7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:37.731213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bad9faf2cd41d79ac77c484c7625a7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:37.734028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:37.792734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bad9faf2cd41d79ac77c484c7625a7', 'request_id': 'req-357125b4-9bf1-4399-b933-aeda45681fe5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.802392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bad9faf2cd41d79ac77c484c7625a7', 'request_id': 'req-357125b4-9bf1-4399-b933-aeda45681fe5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.811792 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bad9faf2cd41d79ac77c484c7625a7', 'request_id': 'req-357125b4-9bf1-4399-b933-aeda45681fe5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.826432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] The token cache is being invalidate because project 73bad9faf2cd41d79ac77c484c7625a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:37.827058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.827778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-357125b4-9bf1-4399-b933-aeda45681fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:37.829506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 859/1700] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:37 2022] DELETE /identity/v3/projects/73bad9faf2cd41d79ac77c484c7625a7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:37.834508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:37.834821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:37.835121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:37.861367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:37.863011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:37.930471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 842/1701] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:37.938883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aedda9-59e8-42fe-8a56-e9d7c5a2858e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:37.939278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aedda9-59e8-42fe-8a56-e9d7c5a2858e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:37.939644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aedda9-59e8-42fe-8a56-e9d7c5a2858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:37.948711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:37.950176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:37.963349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b6a6b-76b2-4cce-8fc7-946da6a95257 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:37.969692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:37.970427 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-47aedda9-59e8-42fe-8a56-e9d7c5a2858e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:37.970547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:37.970816 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:37.971153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] PATH_INFO: `/v3/projects/a6323958b69748b78560ffd82da9cca9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:37.971660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-47aedda9-59e8-42fe-8a56-e9d7c5a2858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:37.972515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6323958b69748b78560ffd82da9cca9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:37.974684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:37.982731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 860/1702] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:37.986938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aedda9-59e8-42fe-8a56-e9d7c5a2858e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:37.996337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aedda9-59e8-42fe-8a56-e9d7c5a2858e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.001614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.002343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.002625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.003003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.003721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:38.004094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.005750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.018101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 861/1703] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:06:38.022694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.029033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6323958b69748b78560ffd82da9cca9', 'request_id': 'req-a15deadb-3d26-47c2-ad8f-d5a13131d438'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.032774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520780b3-d666-4b8f-81db-0d159ad656b4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.035491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6323958b69748b78560ffd82da9cca9', 'request_id': 'req-a15deadb-3d26-47c2-ad8f-d5a13131d438'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.036659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:38.043465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6323958b69748b78560ffd82da9cca9', 'request_id': 'req-a15deadb-3d26-47c2-ad8f-d5a13131d438'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.057640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] The token cache is being invalidate because project a6323958b69748b78560ffd82da9cca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:38.057941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.058650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.061698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 843/1704] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:37 2022] DELETE /identity/v3/projects/a6323958b69748b78560ffd82da9cca9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:38.071906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.075096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:38.111723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.112337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.112623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.112897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.113566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.115537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.146580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 862/1705] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:38 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:38.150258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.151648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15deadb-3d26-47c2-ad8f-d5a13131d438 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.151869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:38.187382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:38.218671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f3f86-cec2-488a-a79f-7ea9e061fa21 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.223568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.224253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.224658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.224999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.225753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.227769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.235079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.235749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.236144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.236781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] PATH_INFO: `/v3/users/e0e8392622e243d3821e62001f3c8cd7` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.239059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e8392622e243d3821e62001f3c8cd7)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.242178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.254888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 863/1706] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:38 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:38.257932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.270125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26852249-98ce-4cf1-a8ad-e74eeda9df00 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.273832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.274521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.274804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.275080 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.275728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.277335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.288575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 864/1707] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:38.292454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.301476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e8392622e243d3821e62001f3c8cd7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.304654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ad64-10bc-4bd1-99d2-9b504cc4be2e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.310663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e8392622e243d3821e62001f3c8cd7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.312376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.312978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.313318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.313619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.314289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.316805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.320478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e8392622e243d3821e62001f3c8cd7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.321233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e8392622e243d3821e62001f3c8cd7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.337456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 865/1708] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:38.340825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65d54cda-ebe7-42f8-a811-ec5e8b733900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e8392622e243d3821e62001f3c8cd7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.347564 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.347564 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:38.360054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6aab4-9245-4760-8505-fb8faf4d8e8c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.360908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 844/1709] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:38 2022] DELETE /identity/v3/users/e0e8392622e243d3821e62001f3c8cd7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:38.437681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.438625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.439028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.439230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] PATH_INFO: `/v3/projects/a453c8cf9b54489cbd59858a6b214056/users/0b627cb66a3a4897badc24bc0ca8f1bb/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.442237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:38.468643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a453c8cf9b54489cbd59858a6b214056, user_id=0b627cb66a3a4897badc24bc0ca8f1bb, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.471949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.498154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 866/1710] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:38 2022] PUT /identity/v3/projects/a453c8cf9b54489cbd59858a6b214056/users/0b627cb66a3a4897badc24bc0ca8f1bb/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:38.505776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880901-6360-4991-b54d-9ca663da032b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.506099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880901-6360-4991-b54d-9ca663da032b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.506422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880901-6360-4991-b54d-9ca663da032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.553337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-20880901-6360-4991-b54d-9ca663da032b None None] MFA Rules not processed for user `0b627cb66a3a4897badc24bc0ca8f1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:38.554747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-20880901-6360-4991-b54d-9ca663da032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:38.665085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.666250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 845/1711] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:38.760195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20880901-6360-4991-b54d-9ca663da032b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.761364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7935-34fe-4caa-951f-61db73e1a3a6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.761817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-20880901-6360-4991-b54d-9ca663da032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:38.768060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.768867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.769297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.769577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.770446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.774039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.795974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20880901-6360-4991-b54d-9ca663da032b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.802235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.802947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.803243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.803536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] PATH_INFO: `/v3/projects/49f5468ea4104bf18e75d89686f89e68` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.805065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f5468ea4104bf18e75d89686f89e68)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:38.808458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:38.830858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 867/1712] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:38 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:38.834125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:38.854686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:38.875708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f5468ea4104bf18e75d89686f89e68', 'request_id': 'req-b027f16d-63af-47eb-aa8a-b463bacdc042'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.886854 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f5468ea4104bf18e75d89686f89e68', 'request_id': 'req-b027f16d-63af-47eb-aa8a-b463bacdc042'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.897713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f5468ea4104bf18e75d89686f89e68', 'request_id': 'req-b027f16d-63af-47eb-aa8a-b463bacdc042'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.913143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] The token cache is being invalidate because project 49f5468ea4104bf18e75d89686f89e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:38.913524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.914295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b027f16d-63af-47eb-aa8a-b463bacdc042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:38.916238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 846/1713] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:38 2022] DELETE /identity/v3/projects/49f5468ea4104bf18e75d89686f89e68 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:38.921323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01947730-2413-4acd-b50f-cc920649791d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.921619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01947730-2413-4acd-b50f-cc920649791d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.921902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01947730-2413-4acd-b50f-cc920649791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.922271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae863b-04b8-4805-b828-a435585e6504 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:38.949321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-01947730-2413-4acd-b50f-cc920649791d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:38.951265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-01947730-2413-4acd-b50f-cc920649791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:38.995360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:38.995968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:38.996248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:38.996674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:38.997929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.000222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.024932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 868/1714] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:38 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:39.029009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.030592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 847/1715] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:39.034854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:39.038394 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2935e47-9566-4616-8e2b-9e5d32558ba7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.038723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2935e47-9566-4616-8e2b-9e5d32558ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.039062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2935e47-9566-4616-8e2b-9e5d32558ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.044945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:39.049239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3d519-fca0-43d7-8631-f77813823275 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.057938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.058727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.059019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.059306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.060027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.062266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.064219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d2935e47-9566-4616-8e2b-9e5d32558ba7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:39.066189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d2935e47-9566-4616-8e2b-9e5d32558ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:39.080433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 869/1716] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:39.082537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.083605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 848/1717] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:39.087619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2935e47-9566-4616-8e2b-9e5d32558ba7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.093538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a04fad-3df3-4c54-a5d8-a310e28fc505 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.096802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2935e47-9566-4616-8e2b-9e5d32558ba7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.098387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.098976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.099252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.099523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.100158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.101772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.101958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.102545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.102827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.103106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.103752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:39.104058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.105630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.114649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 870/1718] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:39.118759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.118919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 849/1719] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:06:39.123692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.132989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec4b01-c7b8-4043-9224-d9e6d3f3c6a1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.134230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3683-657c-49aa-89a4-9432db552634 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.138533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.139184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.139565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.139843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] PATH_INFO: `/v3/projects/5af2c69a27a347a9b44249b4a4962749/users/613b5db28fb44ae1b434b95c24794bfe/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.139983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dc6a0-ac30-4b52-993a-3e876c71e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.140585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dc6a0-ac30-4b52-993a-3e876c71e637 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.140864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dc6a0-ac30-4b52-993a-3e876c71e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.141169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dc6a0-ac30-4b52-993a-3e876c71e637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.141824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dc6a0-ac30-4b52-993a-3e876c71e637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.143762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dc6a0-ac30-4b52-993a-3e876c71e637 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.155144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af2c69a27a347a9b44249b4a4962749, user_id=613b5db28fb44ae1b434b95c24794bfe, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.157849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.173948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 871/1720] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:39 2022] PUT /identity/v3/projects/5af2c69a27a347a9b44249b4a4962749/users/613b5db28fb44ae1b434b95c24794bfe/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:39.182924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 850/1721] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:39.184016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.184510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883b9d-ca5d-4ceb-9ba7-1008608c24c7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.184952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883b9d-ca5d-4ceb-9ba7-1008608c24c7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.186114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883b9d-ca5d-4ceb-9ba7-1008608c24c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.215939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9a883b9d-ca5d-4ceb-9ba7-1008608c24c7 None None] MFA Rules not processed for user `613b5db28fb44ae1b434b95c24794bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:39.217593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9a883b9d-ca5d-4ceb-9ba7-1008608c24c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:39.253475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b0ace-cae1-41d0-89e1-6883d2fac73f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.286701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 851/1722] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:39.291154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883b9d-ca5d-4ceb-9ba7-1008608c24c7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.295130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:39.312607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.313220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.313500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.313774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.314441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.317155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.344004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 872/1723] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:39.345008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.355250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3327-9f0e-464c-8495-a305c02cc4a2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.360726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.361311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.361592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.361880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.362535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.363501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883b9d-ca5d-4ceb-9ba7-1008608c24c7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.364179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.368419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.369017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.369295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.369566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.370229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.372099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.377225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 873/1724] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:39.378342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.387682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f440-ae5c-4844-9860-dcc754806e8f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.392808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.393532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.393810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.394217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.394787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.396360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.405399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 852/1725] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:39.406467 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.408120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 874/1726] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:39.411885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.423020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e7ba-7ba4-4f7c-a4e5-2718fc6795ef admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.454653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:39.471491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a1bb-a2e8-4c1e-a5bd-694742530c30 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.476116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.476719 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.477009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.477286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.477952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.479968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.483504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2072b-4a1b-407e-926b-5e89ebd2f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.484257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2072b-4a1b-407e-926b-5e89ebd2f221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.484545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2072b-4a1b-407e-926b-5e89ebd2f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.484955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2072b-4a1b-407e-926b-5e89ebd2f221 admin admin] PATH_INFO: `/v3/projects/48b3b6f50587427d9e3362d73a9219fc/users/bf817fa3b3c348a4b6905dbfac6f6e7f/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.503248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2072b-4a1b-407e-926b-5e89ebd2f221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b3b6f50587427d9e3362d73a9219fc, user_id=bf817fa3b3c348a4b6905dbfac6f6e7f, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.506048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2072b-4a1b-407e-926b-5e89ebd2f221 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.512581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 853/1727] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:39.514517 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.524282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 875/1728] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:39 2022] PUT /identity/v3/projects/48b3b6f50587427d9e3362d73a9219fc/users/bf817fa3b3c348a4b6905dbfac6f6e7f/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:39.530240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76029-fdc4-4c91-83e1-c2f7a7ceaf64 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.537242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1d6d-0965-4519-a414-71469d51ec44 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.537818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1d6d-0965-4519-a414-71469d51ec44 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.538118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1d6d-0965-4519-a414-71469d51ec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.573813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-95bd1d6d-0965-4519-a414-71469d51ec44 None None] MFA Rules not processed for user `bf817fa3b3c348a4b6905dbfac6f6e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:39.575074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-95bd1d6d-0965-4519-a414-71469d51ec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:39.604432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.605335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.605830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.606345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.608012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.611016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.624866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 854/1729] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:39.628954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.640073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5a06-b4a0-498b-87f4-e725144b9482 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.646007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.646770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.647127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.647408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] PATH_INFO: `/v3/projects/7f594161a0db49db9f2afcd12d51c056/users/38d68ed642b8442d93c7936cb467c2e9/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.659444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 876/1730] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:39.660542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:39.663950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1d6d-0965-4519-a414-71469d51ec44 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.667172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f594161a0db49db9f2afcd12d51c056, user_id=38d68ed642b8442d93c7936cb467c2e9, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.670627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.676358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1d6d-0965-4519-a414-71469d51ec44 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.681570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.682890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.682890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.682890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.683370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.685682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 855/1731] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:39 2022] PUT /identity/v3/projects/7f594161a0db49db9f2afcd12d51c056/users/38d68ed642b8442d93c7936cb467c2e9/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:39.686675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.689623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.723386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 877/1732] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:39.728202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.760007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e0afc-4162-4e9f-8629-a7a09ea05b8c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.802109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1e032-d6d4-4326-8579-3d19478f216e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.808632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.809320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.811274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.811274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.811620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.813709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.829316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.829938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.830268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.830516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.831187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.832811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.842151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 878/1733] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:39 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:39.844463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 856/1734] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:39.845921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.848294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.857190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fdab2-8823-4fd8-9a8c-45e875f1b1db admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.858844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcac5-939c-4740-b75e-0708a76fd24f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.861879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.862521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.862802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.863095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.863739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.865329 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.872398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.874462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.875434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.875727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] PATH_INFO: `/v3/projects/7f594161a0db49db9f2afcd12d51c056/users/38d68ed642b8442d93c7936cb467c2e9/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.878495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f594161a0db49db9f2afcd12d51c056, user_id=38d68ed642b8442d93c7936cb467c2e9, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.880850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 879/1735] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:39.883035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:39.888738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.890715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:39.898133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 857/1736] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:39 2022] PUT /identity/v3/projects/7f594161a0db49db9f2afcd12d51c056/users/38d68ed642b8442d93c7936cb467c2e9/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:39.898961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:39.899387 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:39.906327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca279228-5011-4957-bd48-6ac463157350 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.977006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668004-b9d2-4ed2-a31d-1ec6d0453820 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:39.983117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb1b61-c183-4251-b7dc-22aa11026d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.984289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb1b61-c183-4251-b7dc-22aa11026d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.984406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:39.984500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb1b61-c183-4251-b7dc-22aa11026d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.984500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb1b61-c183-4251-b7dc-22aa11026d5c admin admin] PATH_INFO: `/v3/projects/e1ac0be06b734a029a9937bf424794f8/users/b02b3c4588104b91b83d19b9e3b6951f/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.984802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:39.985035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:39.985311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] PATH_INFO: `/v3/users/7fed1b4c6d8542b8b4752054c115b7b3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:39.986482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fed1b4c6d8542b8b4752054c115b7b3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:39.988445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.004089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb1b61-c183-4251-b7dc-22aa11026d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ac0be06b734a029a9937bf424794f8, user_id=b02b3c4588104b91b83d19b9e3b6951f, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.007491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb1b61-c183-4251-b7dc-22aa11026d5c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.026036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 858/1737] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:39 2022] PUT /identity/v3/projects/e1ac0be06b734a029a9937bf424794f8/users/b02b3c4588104b91b83d19b9e3b6951f/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:40.032459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60d9a9-8783-4b17-bf49-7a7aad8424a4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.032755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60d9a9-8783-4b17-bf49-7a7aad8424a4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.033031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60d9a9-8783-4b17-bf49-7a7aad8424a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.040837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:40.047842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fed1b4c6d8542b8b4752054c115b7b3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:40.062888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fed1b4c6d8542b8b4752054c115b7b3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:40.063639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fed1b4c6d8542b8b4752054c115b7b3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:40.064544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fed1b4c6d8542b8b4752054c115b7b3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:40.070275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-db60d9a9-8783-4b17-bf49-7a7aad8424a4 None None] MFA Rules not processed for user `38d68ed642b8442d93c7936cb467c2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:40.071836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-db60d9a9-8783-4b17-bf49-7a7aad8424a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.073908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fed1b4c6d8542b8b4752054c115b7b3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:40.094307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 880/1738] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:39 2022] DELETE /identity/v3/users/7fed1b4c6d8542b8b4752054c115b7b3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:40.095267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:40.098827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.171406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 859/1739] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:40.172846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.173253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.173407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.194348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:40.195791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.203265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253857ae-8a55-4d53-92e5-65965261e91b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:40.205683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 860/1740] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:40.207235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:40.209851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:40.211057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.211772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.212061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.212910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.215068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.218312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.228901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 881/1741] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:40.230129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:40.232493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.258649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:40.298234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db1eeb-3795-4c57-8b23-94391b9315f7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:40.302867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:40.304218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.304730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.305051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.309583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688574-dd31-4515-821f-f6f78e148a8b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:40.314674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:40.315408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.315789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.316156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.327361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.329034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.339718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 882/1742] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:40.340491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:40.355070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d6f27-3907-4bb5-96c5-8dd6a526b7d3 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:40.365803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286ec9-5ddb-4652-b04e-25b04633c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:40.366717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ec9-5ddb-4652-b04e-25b04633c09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.367249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ec9-5ddb-4652-b04e-25b04633c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.367734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286ec9-5ddb-4652-b04e-25b04633c09d admin admin] PATH_INFO: `/v3/projects/e1ac0be06b734a029a9937bf424794f8/users/b02b3c4588104b91b83d19b9e3b6951f/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.371076 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286ec9-5ddb-4652-b04e-25b04633c09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ac0be06b734a029a9937bf424794f8, user_id=b02b3c4588104b91b83d19b9e3b6951f, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.375350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286ec9-5ddb-4652-b04e-25b04633c09d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.392656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 883/1743] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:40 2022] PUT /identity/v3/projects/e1ac0be06b734a029a9937bf424794f8/users/b02b3c4588104b91b83d19b9e3b6951f/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:40.404808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.405148 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.405560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.409998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.412486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.432342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 861/1744] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:40.447556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] MFA Rules not processed for user `b02b3c4588104b91b83d19b9e3b6951f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:40.448749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.549060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 884/1745] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:40.563388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:40.565048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.579215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58825d44-cdbd-460d-8153-1bf3399ba7a4 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:40.634901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:40.673752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:40.674073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.674331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.674621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.686258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.687748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.698649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 862/1746] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:40.744201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:40.745675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.768830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:40.787201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397777c-cb48-4ba6-b72f-6bb686bdd791 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:40.796515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76271a-6d59-4469-bf27-48541df940ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:40.797988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76271a-6d59-4469-bf27-48541df940ca service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.799127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76271a-6d59-4469-bf27-48541df940ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.800462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76271a-6d59-4469-bf27-48541df940ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.810436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7a76271a-6d59-4469-bf27-48541df940ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:40.875177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b9b9f-35d3-4e65-bedc-96c146522318 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:40.880658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:40.881482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:40.881945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:40.882384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] PATH_INFO: `/v3/projects/b77c6be6ed5b4da0a95a7de2bdd1bb41` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:40.883651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77c6be6ed5b4da0a95a7de2bdd1bb41)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.885907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.914601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76271a-6d59-4469-bf27-48541df940ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:40.916580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76271a-6d59-4469-bf27-48541df940ca service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:40.931686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 863/1747] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:40.944395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:40.962637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77c6be6ed5b4da0a95a7de2bdd1bb41', 'request_id': 'req-6779f755-90c2-47f5-9da1-9625ce59b601'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:40.971379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77c6be6ed5b4da0a95a7de2bdd1bb41', 'request_id': 'req-6779f755-90c2-47f5-9da1-9625ce59b601'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:40.984003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77c6be6ed5b4da0a95a7de2bdd1bb41', 'request_id': 'req-6779f755-90c2-47f5-9da1-9625ce59b601'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.003646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] The token cache is being invalidate because project b77c6be6ed5b4da0a95a7de2bdd1bb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:41.004080 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.005020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6779f755-90c2-47f5-9da1-9625ce59b601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.007478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 885/1748] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:40 2022] DELETE /identity/v3/projects/b77c6be6ed5b4da0a95a7de2bdd1bb41 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:41.014881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700885a1-da2c-4c81-93cf-f3a43ddeea48 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.015332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700885a1-da2c-4c81-93cf-f3a43ddeea48 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.015423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700885a1-da2c-4c81-93cf-f3a43ddeea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.050661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-700885a1-da2c-4c81-93cf-f3a43ddeea48 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:41.051889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-700885a1-da2c-4c81-93cf-f3a43ddeea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:41.194576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 864/1749] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:41.195372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.195715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.195992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.221439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:41.222693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:41.234366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 886/1750] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:41.236296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700885a1-da2c-4c81-93cf-f3a43ddeea48 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.264428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700885a1-da2c-4c81-93cf-f3a43ddeea48 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.282096 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.284365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:41.288177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.288930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.289240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.289542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.290978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:41.291291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.306466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.329078 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 865/1751] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:41.332004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.357685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed827924-e8e5-440d-bdcb-02fcc00ffbc9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.366858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.367568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.373462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.373764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.378055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.382292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.389448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd3945-efd9-4c9c-a12a-79fbd2a654fe None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.393958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.394934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.395352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.395829 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.398746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:41.439983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 866/1752] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:41 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:41.444799 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.495057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.497689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.524156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 887/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:41.548641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:41.608135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2b220-ca6f-432f-afa7-e6c198d9f2b1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.621595 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.622895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.623188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.623467 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.624288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.630752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.660866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 867/1754] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:41 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:41.662233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.679622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392f18-a0e8-4f7e-aee6-623345ced666 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.694608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.695719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.698341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.699070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.699372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.702201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.713982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 888/1755] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:41.717412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.719340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:41.727559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.737868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863674fc-9da7-4eaa-a11a-95d2ee1bf091 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.745349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f345f20-b10b-469f-a3cd-1d312e3e3723 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.750193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.750841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.751127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.751407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] PATH_INFO: `/v3/users/94fe86eb85c64d6d9789bc9f83238372` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.753086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fe86eb85c64d6d9789bc9f83238372)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.755089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.759436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.760188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.760439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.760716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.762646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.764145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.788330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 889/1756] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:41.795901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:41.836155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542992-2849-4180-8edf-6fd20e479918 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:41.849881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d078b7-a52e-4518-aee5-f64818be7bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:41.850597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d078b7-a52e-4518-aee5-f64818be7bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.852104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d078b7-a52e-4518-aee5-f64818be7bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.852104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d078b7-a52e-4518-aee5-f64818be7bbc admin admin] PATH_INFO: `/v3/projects/91bef1e1721d42949af423ace4bb86fa/users/49a6474d8cb04af0a32b2597a6ed1feb/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.870898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fe86eb85c64d6d9789bc9f83238372'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.892992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fe86eb85c64d6d9789bc9f83238372'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.895236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d078b7-a52e-4518-aee5-f64818be7bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bef1e1721d42949af423ace4bb86fa, user_id=49a6474d8cb04af0a32b2597a6ed1feb, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:41.899720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d078b7-a52e-4518-aee5-f64818be7bbc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:41.912084 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fe86eb85c64d6d9789bc9f83238372'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.913297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fe86eb85c64d6d9789bc9f83238372'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.938225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1db86649-a803-42ec-8dd5-96b6838fff61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fe86eb85c64d6d9789bc9f83238372'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:41.938632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 890/1757] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:41 2022] PUT /identity/v3/projects/91bef1e1721d42949af423ace4bb86fa/users/49a6474d8cb04af0a32b2597a6ed1feb/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:41.949058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.952633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.953330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.964940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 868/1758] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:41 2022] DELETE /identity/v3/users/94fe86eb85c64d6d9789bc9f83238372 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:41.967503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:41.967892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:41.968346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:41.997415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:41.998776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:42.012462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] MFA Rules not processed for user `49a6474d8cb04af0a32b2597a6ed1feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:42.045553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:42.077155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:42.157709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 869/1759] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:42.158898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:42.162232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:42.259978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 891/1760] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:42.269654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:42.271492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:42.312200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:42.347547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab30cf-fc90-4086-9e50-839934805893 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:42.357444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:42.358259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:42.358604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:42.358914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:42.381242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:42.382722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:42.414420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 870/1761] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:42.471001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8a3d-fca2-447d-80f8-fd517b5bb56d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:42.481572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a718a-aa30-427f-ad46-bb7cc32b5420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:42.482185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a718a-aa30-427f-ad46-bb7cc32b5420 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:42.482471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a718a-aa30-427f-ad46-bb7cc32b5420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:42.482749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a718a-aa30-427f-ad46-bb7cc32b5420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:42.502523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a718a-aa30-427f-ad46-bb7cc32b5420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:42.507154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a718a-aa30-427f-ad46-bb7cc32b5420 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:42.533238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 892/1762] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:42.584921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:42.586409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:42.628598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270ff47-cc18-45f5-806c-3cf6fa7c0ea5 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:42.644880 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:42.645740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:42.646154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:42.646537 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] PATH_INFO: `/v3/users/49a6474d8cb04af0a32b2597a6ed1feb` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:42.647930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a6474d8cb04af0a32b2597a6ed1feb)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:42.651333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:42.760068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a6474d8cb04af0a32b2597a6ed1feb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:42.769803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a6474d8cb04af0a32b2597a6ed1feb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:42.787122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a6474d8cb04af0a32b2597a6ed1feb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:42.788080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a6474d8cb04af0a32b2597a6ed1feb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:42.809479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a6474d8cb04af0a32b2597a6ed1feb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:42.827369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 871/1763] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:42 2022] DELETE /identity/v3/users/49a6474d8cb04af0a32b2597a6ed1feb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:42.831793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:42.832282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:42.832563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:42.865903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:42.867160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:42.938874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:42.940316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:43.009283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 893/1764] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:43.020587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:43.022924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:43.053615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69f9e-7de8-42df-9fd3-55ba0813f784 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:43.058599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:43.059093 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:43.059380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:43.060167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] PATH_INFO: `/v3/projects/5c941528e0b04161ab78e4c2a90fb965` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:43.061693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c941528e0b04161ab78e4c2a90fb965)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:43.063972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:43.119864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c007e3-f3da-4828-838e-5d64eadb6aa2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:43.126353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c941528e0b04161ab78e4c2a90fb965', 'request_id': 'req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.130191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:43.137382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c941528e0b04161ab78e4c2a90fb965', 'request_id': 'req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.141239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:43.151149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c941528e0b04161ab78e4c2a90fb965', 'request_id': 'req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.189488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:43.190267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:43.190485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] The token cache is being invalidate because project 5c941528e0b04161ab78e4c2a90fb965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:43.190921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:43.191010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.191257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:43.191480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.193523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:43.197706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 872/1765] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:42 2022] DELETE /identity/v3/projects/5c941528e0b04161ab78e4c2a90fb965 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:43.204910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:43.207110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:43.331459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:43.333343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:43.334064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2b38-3fa8-44e7-99a7-8f063ebd3b63 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:43.352851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:43.353632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:43.353744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 894/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:43.353918 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:43.354286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] PATH_INFO: `/v3/users/5fd76cf503bb4bd781ea608a87db795c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:43.355561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd76cf503bb4bd781ea608a87db795c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:43.358229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:43.433493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd76cf503bb4bd781ea608a87db795c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.447898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd76cf503bb4bd781ea608a87db795c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.463395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd76cf503bb4bd781ea608a87db795c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.463395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd76cf503bb4bd781ea608a87db795c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.481400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd76cf503bb4bd781ea608a87db795c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:43.494283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 873/1767] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:43 2022] DELETE /identity/v3/users/5fd76cf503bb4bd781ea608a87db795c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:43.937425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:43.939232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:43.955469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cebd8-98f3-45fe-93ae-a40b33761817 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:43.999181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:44.001335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.112363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:44.114859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.115686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.116932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] PATH_INFO: `/v3/projects/91bef1e1721d42949af423ace4bb86fa` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.118644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bef1e1721d42949af423ace4bb86fa)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:44.123906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:44.209346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e147-28d9-4703-83f9-39d6b66d1150 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:44.213240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bef1e1721d42949af423ace4bb86fa', 'request_id': 'req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.225376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bef1e1721d42949af423ace4bb86fa', 'request_id': 'req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.230879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:44.246255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bef1e1721d42949af423ace4bb86fa', 'request_id': 'req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.253601 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:44.267839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] The token cache is being invalidate because project 91bef1e1721d42949af423ace4bb86fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:44.268839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.269762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-06fd8eeb-f827-4c48-b4b9-b76ae70c4e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.272660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 895/1768] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:43 2022] DELETE /identity/v3/projects/91bef1e1721d42949af423ace4bb86fa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:44.278225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5604-bfc5-44ec-acdc-2619108733e5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.279432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5604-bfc5-44ec-acdc-2619108733e5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.279842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5604-bfc5-44ec-acdc-2619108733e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.315118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3e5f5604-bfc5-44ec-acdc-2619108733e5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:44.316680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3e5f5604-bfc5-44ec-acdc-2619108733e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.368425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:44.368954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.369331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.369505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] PATH_INFO: `/v3/projects/b2a490b079ad42a0b1f9b7ebd47c61e1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.379286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a490b079ad42a0b1f9b7ebd47c61e1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:44.384652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:44.447204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 896/1769] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:44.467653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd632e-0ecc-46f7-85ca-118eb38f5dec None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.467875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd632e-0ecc-46f7-85ca-118eb38f5dec None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.468206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd632e-0ecc-46f7-85ca-118eb38f5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.500602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8dcd632e-0ecc-46f7-85ca-118eb38f5dec None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:44.502323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8dcd632e-0ecc-46f7-85ca-118eb38f5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.519257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a490b079ad42a0b1f9b7ebd47c61e1', 'request_id': 'req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.536795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a490b079ad42a0b1f9b7ebd47c61e1', 'request_id': 'req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.550962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a490b079ad42a0b1f9b7ebd47c61e1', 'request_id': 'req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.583079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] The token cache is being invalidate because project b2a490b079ad42a0b1f9b7ebd47c61e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:44.583496 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.584245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b6b4d7a-48b7-41c2-a3a1-1590cc02020a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.592104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 874/1770] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:43 2022] DELETE /identity/v3/projects/b2a490b079ad42a0b1f9b7ebd47c61e1 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:44.593695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e528-92c0-4520-b99e-782ae9a7b3ec None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.593985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e528-92c0-4520-b99e-782ae9a7b3ec None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.594290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e528-92c0-4520-b99e-782ae9a7b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.634037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f4e3e528-92c0-4520-b99e-782ae9a7b3ec None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:44.635735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f4e3e528-92c0-4520-b99e-782ae9a7b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.656769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 875/1771] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:44.659877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.660165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.660506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.662357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 897/1772] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:44.666953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd632e-0ecc-46f7-85ca-118eb38f5dec None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:44.691293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd632e-0ecc-46f7-85ca-118eb38f5dec None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:44.698954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:44.701040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.707606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:44.707994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.708350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.708830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.709702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:44.709953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:44.711616 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:44.728377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 876/1773] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:44.729421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:44.731229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.753690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 898/1774] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:06:44.753690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:44.759973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed40d-b4d9-49bb-972f-6b009b775511 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:44.767020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:44.768349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.768884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.769391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] PATH_INFO: `/v3/users/bf817fa3b3c348a4b6905dbfac6f6e7f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.770841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf817fa3b3c348a4b6905dbfac6f6e7f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:44.773750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:44.776327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8d40-e207-42ae-836d-3aa4428679a6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:44.789899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:44.790861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.791326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.791902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.792914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:44.793390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:44.795396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:44.813145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 899/1775] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:44.816763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:44.828086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aeab8-09bb-4460-a20f-b20ee7ccfc55 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:44.833683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:44.834218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.834505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.834780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.835941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:44.837546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:44.846605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf817fa3b3c348a4b6905dbfac6f6e7f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.855818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf817fa3b3c348a4b6905dbfac6f6e7f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.865118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf817fa3b3c348a4b6905dbfac6f6e7f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.865877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf817fa3b3c348a4b6905dbfac6f6e7f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.873235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 900/1776] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:44 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:44.874614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:44.876210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.884224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf817fa3b3c348a4b6905dbfac6f6e7f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:44.888995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:44.894575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 877/1777] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:44 2022] DELETE /identity/v3/users/bf817fa3b3c348a4b6905dbfac6f6e7f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:44.898322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:44.901407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:44.942913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:44.967859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe6c3-dcee-4e6f-80c3-308972274f3f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:44.988480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73224f-25c6-42e0-a02d-a059bd11d96f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:44.994933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:44.995728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:44.996012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:44.996287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:44.997857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.000339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.034471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.034670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 878/1778] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:44 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:45.038401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.038401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.038633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.038726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] PATH_INFO: `/v3/users/66585fd9c7304bc08c419a49ac3476f4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.038814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.039075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66585fd9c7304bc08c419a49ac3476f4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.040975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.094484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66585fd9c7304bc08c419a49ac3476f4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.106913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66585fd9c7304bc08c419a49ac3476f4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.107843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66585fd9c7304bc08c419a49ac3476f4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.108485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66585fd9c7304bc08c419a49ac3476f4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.110883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c088b0-7733-408d-b2a8-cd410b142cd0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.116293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6240d1a2-e598-4774-a43c-9a25ec55f8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66585fd9c7304bc08c419a49ac3476f4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.116798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.117314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.117594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.117898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.118699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.120478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.129455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 901/1779] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:44 2022] DELETE /identity/v3/users/66585fd9c7304bc08c419a49ac3476f4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:45.130491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.130775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.131044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.147010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 879/1780] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:45 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:45.151458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.152400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:45.153339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.154057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.168393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d6f1-a185-4111-88f1-1ca7b4c80a12 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.228077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 902/1781] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:45.229160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.230631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.244050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286d629-5f38-4b1a-8f59-05a33c6d5cdd None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.249587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.250234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.251159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.251459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.252344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.253878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.257722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.258556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.258992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.260211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.261149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.263145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.269981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 903/1782] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:45.269981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.272279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.279407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:45.291405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 880/1783] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:45 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:45.292234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.299146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:45.303094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cac89-7dcf-42c7-87f0-76802a506d7a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.313803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.314674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.315002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.315443 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.316170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.317757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.330934 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 881/1784] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:45.331906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.347312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e389-7681-4d05-9994-d5dacb8451ab admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.352389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.353012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.353391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.353665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.354403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.355465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843ea0-de69-4537-84fe-fe10980e0776 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.356242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.361254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.362395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.362779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.363762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.374539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.375986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.376721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 882/1785] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:45.377546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.386187 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 904/1786] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:45.387008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.389025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.390100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d972593-5320-4cb0-9850-23386cbbe00e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.394986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.395778 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.396129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.396510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] PATH_INFO: `/v3/projects/04c87c6f249a40bfa38f3f3b53620c90/users/957cb82c764d478d8a82fb8bb44024f3/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.401345 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16523a8-d042-44c7-82ef-4272f6f1a163 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.406227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.406859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.407139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.407416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] PATH_INFO: `/v3/projects/bb0a0e1471af4fe5b343f52818567fd6` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.409963 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0a0e1471af4fe5b343f52818567fd6)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.412308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.424324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c87c6f249a40bfa38f3f3b53620c90, user_id=957cb82c764d478d8a82fb8bb44024f3, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.430377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.452310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 883/1787] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:45 2022] PUT /identity/v3/projects/04c87c6f249a40bfa38f3f3b53620c90/users/957cb82c764d478d8a82fb8bb44024f3/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:45.453586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.482776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0a0e1471af4fe5b343f52818567fd6', 'request_id': 'req-74d83423-0c4b-4237-8890-4c4a7173564a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.492287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0a0e1471af4fe5b343f52818567fd6', 'request_id': 'req-74d83423-0c4b-4237-8890-4c4a7173564a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.501977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0a0e1471af4fe5b343f52818567fd6', 'request_id': 'req-74d83423-0c4b-4237-8890-4c4a7173564a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.513514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] The token cache is being invalidate because project bb0a0e1471af4fe5b343f52818567fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:45.513514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.514313 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74d83423-0c4b-4237-8890-4c4a7173564a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.519648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 905/1788] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:45 2022] DELETE /identity/v3/projects/bb0a0e1471af4fe5b343f52818567fd6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:45.519648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431fda-6263-40f9-9111-3592802be99a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.519648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431fda-6263-40f9-9111-3592802be99a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.519648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431fda-6263-40f9-9111-3592802be99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.526752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695563-db10-440f-91f8-ea6ea0d1235f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.541384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-47431fda-6263-40f9-9111-3592802be99a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:45.542746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-47431fda-6263-40f9-9111-3592802be99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.596398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d48a33-80cc-4050-9a9a-af2d80861ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.596806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48a33-80cc-4050-9a9a-af2d80861ede admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.597292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48a33-80cc-4050-9a9a-af2d80861ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.597413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48a33-80cc-4050-9a9a-af2d80861ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.597996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d48a33-80cc-4050-9a9a-af2d80861ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.599692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d48a33-80cc-4050-9a9a-af2d80861ede admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.614469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 884/1789] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:45.614469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.614469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.614469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.626234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 906/1790] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:45.630132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47431fda-6263-40f9-9111-3592802be99a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.631670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-47431fda-6263-40f9-9111-3592802be99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.637184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:45.639389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.644411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47431fda-6263-40f9-9111-3592802be99a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.648986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5f583-6715-4e6b-b1f4-b795b886e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.649639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f583-6715-4e6b-b1f4-b795b886e799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.649913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f583-6715-4e6b-b1f4-b795b886e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.650211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f583-6715-4e6b-b1f4-b795b886e799 admin admin] PATH_INFO: `/v3/projects/70585b2849c844929416449e41126bc5/users/7251762bc1124518b8c50e5acc808cd4/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.652063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 885/1791] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:45.654427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.655779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.667278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5f583-6715-4e6b-b1f4-b795b886e799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70585b2849c844929416449e41126bc5, user_id=7251762bc1124518b8c50e5acc808cd4, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.671247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5f583-6715-4e6b-b1f4-b795b886e799 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.687533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 907/1792] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:45 2022] PUT /identity/v3/projects/70585b2849c844929416449e41126bc5/users/7251762bc1124518b8c50e5acc808cd4/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:45.688950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3656da-a8aa-4f2e-9cb0-10df6e1172e8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.689301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3656da-a8aa-4f2e-9cb0-10df6e1172e8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.689583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3656da-a8aa-4f2e-9cb0-10df6e1172e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.699195 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:45.713251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8c3656da-a8aa-4f2e-9cb0-10df6e1172e8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:45.714497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8c3656da-a8aa-4f2e-9cb0-10df6e1172e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.733148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f2291-a283-4e59-b6d7-7ea71862bc25 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.742899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:45.791395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 908/1793] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:45.792743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c6916-79c8-4ec9-bb84-721e6393101b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.793091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c6916-79c8-4ec9-bb84-721e6393101b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.793310 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c6916-79c8-4ec9-bb84-721e6393101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.803289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.803903 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.804185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.804457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.814695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.816122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.822742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-453c6916-79c8-4ec9-bb84-721e6393101b None None] MFA Rules not processed for user `7251762bc1124518b8c50e5acc808cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:45.823952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-453c6916-79c8-4ec9-bb84-721e6393101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.825839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 886/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:45.826693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.828451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:45.846303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19045c-0e25-4426-a0ea-c1d50c4d82df service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.851863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:45.852601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:45.852893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:45.853223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] PATH_INFO: `/v3/projects/48b3b6f50587427d9e3362d73a9219fc` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:45.854331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b3b6f50587427d9e3362d73a9219fc)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:45.856330 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:45.900038 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 909/1795] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:45.912057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c6916-79c8-4ec9-bb84-721e6393101b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.915164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b3b6f50587427d9e3362d73a9219fc', 'request_id': 'req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.924763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b3b6f50587427d9e3362d73a9219fc', 'request_id': 'req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.928271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c6916-79c8-4ec9-bb84-721e6393101b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:45.933319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b3b6f50587427d9e3362d73a9219fc', 'request_id': 'req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.945997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] The token cache is being invalidate because project 48b3b6f50587427d9e3362d73a9219fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:45.946386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.947134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:45.948969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 887/1796] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:45 2022] DELETE /identity/v3/projects/48b3b6f50587427d9e3362d73a9219fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:45.949596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:45.953317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.004794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.005706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.005990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.006462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.007184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:46.007494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.010062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.025241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679caaf7-bb22-4c29-b8c2-c68ccd1c9ebf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.026490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 910/1797] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:46.027625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.031178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.031915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.032244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.032723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.034286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.036381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.050253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669026a-3854-4ed1-bf7e-a99e9893b978 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.063201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.066576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.067082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.067623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] PATH_INFO: `/v3/users/b02b3c4588104b91b83d19b9e3b6951f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.069060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02b3c4588104b91b83d19b9e3b6951f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.071759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.120303 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:46.123083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:46.141659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.143655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.156311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 888/1798] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:46.157706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.158594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02b3c4588104b91b83d19b9e3b6951f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:46.159920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.185478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70336d-77dc-4f06-8513-b11a507b5c54 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.190755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02b3c4588104b91b83d19b9e3b6951f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:46.191207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.191825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.192115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.192393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.192626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02b3c4588104b91b83d19b9e3b6951f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:46.193038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.193809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02b3c4588104b91b83d19b9e3b6951f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:46.195000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.206525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02b3c4588104b91b83d19b9e3b6951f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:46.224572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 911/1799] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:46 2022] DELETE /identity/v3/users/b02b3c4588104b91b83d19b9e3b6951f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:46.265005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 889/1800] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:46 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:46.266745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.269127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.357539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca8cf9-8d6d-4c96-a905-b2afa2e8425d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.415225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.418036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.486353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.489266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.489609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.489895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.490590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.492532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.549978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 912/1801] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:46 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:46.551295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.556873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67e1a2-4c51-4726-82e8-57d369195153 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.567589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.568300 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.568938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.569307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.571857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.572905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23bfaf-8def-436d-bff0-677b948d66af admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.586020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.586670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.586952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.587226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.587879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.589491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.615563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 913/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:46.621191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.650266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695df457-160f-4ebf-a21e-b1db8feb052b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.658645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.661506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.662662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.663881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.664221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.664427 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.672485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.674312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.681492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 890/1803] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:46.734774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 914/1804] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:46.738698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.772521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce0bc-d4f3-4b5a-8bd2-096bfbf0679b service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.785930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dc1cc-dc16-47d1-b662-995701b58f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.787068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc1cc-dc16-47d1-b662-995701b58f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.787348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc1cc-dc16-47d1-b662-995701b58f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.788486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc1cc-dc16-47d1-b662-995701b58f68 admin admin] PATH_INFO: `/v3/projects/c89b9b8bd5dc49798ac834bb86c2fde3/users/01156595a74941a9933834c824f87952/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.814964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:46.819306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:46.853821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc1cc-dc16-47d1-b662-995701b58f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89b9b8bd5dc49798ac834bb86c2fde3, user_id=01156595a74941a9933834c824f87952, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.871500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96265e7d-f6fa-4b39-a941-73d321cea48f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:46.875195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc1cc-dc16-47d1-b662-995701b58f68 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.881450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:46.882577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.882853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.883301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] PATH_INFO: `/v3/projects/e1ac0be06b734a029a9937bf424794f8` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.885060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ac0be06b734a029a9937bf424794f8)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:46.889913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:46.901850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 891/1805] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:46 2022] PUT /identity/v3/projects/c89b9b8bd5dc49798ac834bb86c2fde3/users/01156595a74941a9933834c824f87952/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:46.912241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:46.915815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:46.916181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:46.916463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:46.955260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:46.956579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:47.008999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ac0be06b734a029a9937bf424794f8', 'request_id': 'req-4601669f-4d82-4434-ad4d-ce897086d5f9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:47.018696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ac0be06b734a029a9937bf424794f8', 'request_id': 'req-4601669f-4d82-4434-ad4d-ce897086d5f9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:47.030817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ac0be06b734a029a9937bf424794f8', 'request_id': 'req-4601669f-4d82-4434-ad4d-ce897086d5f9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:47.053117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] The token cache is being invalidate because project e1ac0be06b734a029a9937bf424794f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:47.053413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:47.054177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4601669f-4d82-4434-ad4d-ce897086d5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:47.056021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 915/1806] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:46 2022] DELETE /identity/v3/projects/e1ac0be06b734a029a9937bf424794f8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:47.062964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be83e-8f3f-4ec5-90a5-656e5dbd9d84 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.063217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be83e-8f3f-4ec5-90a5-656e5dbd9d84 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.063472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be83e-8f3f-4ec5-90a5-656e5dbd9d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.095056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-026be83e-8f3f-4ec5-90a5-656e5dbd9d84 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:47.096874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-026be83e-8f3f-4ec5-90a5-656e5dbd9d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:47.099821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:47.119240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 892/1807] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:47.134842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:47.136385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:47.210751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 916/1808] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:47.220724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3df64-d890-46fd-9eab-5ae2ca271813 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.221018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3df64-d890-46fd-9eab-5ae2ca271813 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.221296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3df64-d890-46fd-9eab-5ae2ca271813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.270122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7bb3df64-d890-46fd-9eab-5ae2ca271813 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:47.272864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7bb3df64-d890-46fd-9eab-5ae2ca271813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:47.285242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9ee5c-1fbb-4c07-9793-488e37a495a4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:47.306386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 917/1809] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:47.308917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3df64-d890-46fd-9eab-5ae2ca271813 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:47.331291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3df64-d890-46fd-9eab-5ae2ca271813 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:47.344301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:47.345164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.345448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.345725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.346451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:47.346789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:47.350569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:47.367872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:47.369161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.369727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.370423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.392460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 918/1810] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:06:47.393621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:47.394865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:47.396110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:47.419636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 893/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:47.420841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708a9b3-74b3-4774-8cad-6622a593f686 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:47.436446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:47.437118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.437472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.437754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.438846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:47.445521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:47.515124 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 919/1812] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:47 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:47.516445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:47.542211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82819-cbd5-4d6f-8263-4e428738e28a service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:47.723783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:47.725958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.726491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.728357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.731460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:47.736028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:47.776924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 894/1813] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:47 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:47.782713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:47.798531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252302-ed84-4841-8f6a-ba0919e41906 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:47.810552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:47.811420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.811702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.811976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.812631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:47.815828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:47.844418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 920/1814] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:47.848431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:47.862607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8244b-7b50-4678-a302-365526c3eb6f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:47.876141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c78264-0ca7-4771-be49-2931ce7928d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:47.877344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c78264-0ca7-4771-be49-2931ce7928d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.877821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c78264-0ca7-4771-be49-2931ce7928d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.878406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c78264-0ca7-4771-be49-2931ce7928d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:47.879504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c78264-0ca7-4771-be49-2931ce7928d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:47.885287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c78264-0ca7-4771-be49-2931ce7928d8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:47.908529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 895/1815] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:47.914527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:47.936273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb8aca-7505-4b3d-8a35-742d09d87974 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:47.947127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:47.947816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:47.948100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:47.949672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] PATH_INFO: `/v3/projects/9182589cc3074bd9bdc31de6d3ade5fd/users/f82a2bf1e0664668af65cdf7ba3740f5/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:48.000272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9182589cc3074bd9bdc31de6d3ade5fd, user_id=f82a2bf1e0664668af65cdf7ba3740f5, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:48.002990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:48.042799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 921/1816] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:47 2022] PUT /identity/v3/projects/9182589cc3074bd9bdc31de6d3ade5fd/users/f82a2bf1e0664668af65cdf7ba3740f5/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:48.045774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a52d4-d00b-41ae-bbe0-55ecf715eccf None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:48.046569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a52d4-d00b-41ae-bbe0-55ecf715eccf None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:48.046857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a52d4-d00b-41ae-bbe0-55ecf715eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:48.092838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-435a52d4-d00b-41ae-bbe0-55ecf715eccf None None] MFA Rules not processed for user `f82a2bf1e0664668af65cdf7ba3740f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:48.094936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-435a52d4-d00b-41ae-bbe0-55ecf715eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:48.183986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:48.303353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:48.304023 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 896/1817] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:48.413618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:48.469575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355dc65-5904-414c-8c77-16b677f2deb1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:48.480322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:48.481372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:48.482368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:48.482823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:48.483776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:48.485842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:48.527474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 922/1818] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:48 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:48.532070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a52d4-d00b-41ae-bbe0-55ecf715eccf None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:48.574820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a52d4-d00b-41ae-bbe0-55ecf715eccf None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:48.681402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:48.682044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:48.682378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:48.682654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:48.683324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:48.685382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:48.718730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 897/1819] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:48 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:48.720110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:48.731793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15030f4-1543-416e-b68f-103e2184a9d7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:48.738396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:48.739674 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:48.740195 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:48.740702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:48.742037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:48.744437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:48.766047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:48.766691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 923/1820] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:48.784245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef2b4b-e99e-4982-812a-b7dc5cb8d48f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:48.798563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:48.799374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:48.799669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:48.799950 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] PATH_INFO: `/v3/projects/acbfae9d0ee341c789c4997a724951a3/users/87452c4f6d61473492a41fe56420f4d2/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:48.823727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbfae9d0ee341c789c4997a724951a3, user_id=87452c4f6d61473492a41fe56420f4d2, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:48.827077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:48.854290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 898/1821] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:48 2022] PUT /identity/v3/projects/acbfae9d0ee341c789c4997a724951a3/users/87452c4f6d61473492a41fe56420f4d2/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:48.857154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:48.873681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a0102-d83b-4f47-8e7c-c939c0902085 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:48.961202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c136e-992e-49d5-8643-3bd13ba585fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:48.962322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c136e-992e-49d5-8643-3bd13ba585fa admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:48.962799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c136e-992e-49d5-8643-3bd13ba585fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:48.963256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c136e-992e-49d5-8643-3bd13ba585fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:48.964249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c136e-992e-49d5-8643-3bd13ba585fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:48.966377 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c136e-992e-49d5-8643-3bd13ba585fa admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:48.978388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 924/1822] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:06:48.982901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:48.996781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64ad2f-a08a-402b-8579-4d3b2d785afe admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:49.004002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:49.005219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:49.005219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:49.005397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] PATH_INFO: `/v3/projects/acbfae9d0ee341c789c4997a724951a3/users/87452c4f6d61473492a41fe56420f4d2/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:49.007620 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbfae9d0ee341c789c4997a724951a3, user_id=87452c4f6d61473492a41fe56420f4d2, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:49.010380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:49.027724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 899/1823] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:48 2022] PUT /identity/v3/projects/acbfae9d0ee341c789c4997a724951a3/users/87452c4f6d61473492a41fe56420f4d2/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:49.039045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57272a78-7c2f-453a-8723-59af9a0ceb3a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:49.039430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57272a78-7c2f-453a-8723-59af9a0ceb3a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:49.039718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57272a78-7c2f-453a-8723-59af9a0ceb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:49.071908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-57272a78-7c2f-453a-8723-59af9a0ceb3a None None] MFA Rules not processed for user `87452c4f6d61473492a41fe56420f4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:49.073335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-57272a78-7c2f-453a-8723-59af9a0ceb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:49.173160 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 925/1824] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:49.181219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:49.183057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:49.282026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31491dd3-fa50-4e5b-8889-5f46e5876378 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:49.286456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:49.287028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:49.287313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:49.287589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:49.311368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:49.312819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:49.340475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 900/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:49.749866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57272a78-7c2f-453a-8723-59af9a0ceb3a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:49.766568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57272a78-7c2f-453a-8723-59af9a0ceb3a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:49.775430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b14ff4-73cb-45a3-bde7-ffe81cf1e019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:49.776628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14ff4-73cb-45a3-bde7-ffe81cf1e019 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:49.777820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14ff4-73cb-45a3-bde7-ffe81cf1e019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:49.778894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14ff4-73cb-45a3-bde7-ffe81cf1e019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:49.809394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:49.944607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b14ff4-73cb-45a3-bde7-ffe81cf1e019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:49.949482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b14ff4-73cb-45a3-bde7-ffe81cf1e019 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:49.982197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 926/1826] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:50.258370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:50.272053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:50.347315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:50.471523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d89d-3e07-4422-a35f-42080b21f756 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:50.487896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:50.489116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:50.489966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:50.490888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] PATH_INFO: `/v3/users/0b627cb66a3a4897badc24bc0ca8f1bb` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:50.493762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b627cb66a3a4897badc24bc0ca8f1bb)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:50.497499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:50.676483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b627cb66a3a4897badc24bc0ca8f1bb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:50.676483 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b627cb66a3a4897badc24bc0ca8f1bb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:50.694249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b627cb66a3a4897badc24bc0ca8f1bb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:50.696866 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b627cb66a3a4897badc24bc0ca8f1bb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:50.734802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b627cb66a3a4897badc24bc0ca8f1bb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:50.751464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 901/1827] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:50 2022] DELETE /identity/v3/users/0b627cb66a3a4897badc24bc0ca8f1bb => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:50.757362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:50.757878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:50.757986 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:50.816344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:50.817667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:50.922707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 927/1828] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:50.931075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:50.935440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:51.038305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d85c47-6b82-404f-901c-026029f8d0a9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:51.043096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:51.045645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:51.046268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:51.047442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:51.062776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:51.066029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:51.086685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 902/1829] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:52.162008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:52.163776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:52.194647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b4d6b-651e-4798-9371-45f8200e7b73 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:52.223187 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:52.224120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:52.224551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:52.225994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] PATH_INFO: `/v3/projects/a453c8cf9b54489cbd59858a6b214056` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:52.230361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a453c8cf9b54489cbd59858a6b214056)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:52.232723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:52.386794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a453c8cf9b54489cbd59858a6b214056', 'request_id': 'req-5fc7164f-a768-4137-bbb2-9147a9442faf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.396240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a453c8cf9b54489cbd59858a6b214056', 'request_id': 'req-5fc7164f-a768-4137-bbb2-9147a9442faf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.407045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a453c8cf9b54489cbd59858a6b214056', 'request_id': 'req-5fc7164f-a768-4137-bbb2-9147a9442faf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.427622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] The token cache is being invalidate because project a453c8cf9b54489cbd59858a6b214056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:52.428167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.429193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.435452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 928/1830] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:52 2022] DELETE /identity/v3/projects/a453c8cf9b54489cbd59858a6b214056 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:52.439419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:52.455871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b33f7-a991-486b-ae01-ce6a23096001 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:52.574011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:52.629117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:52.631992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:52.632356 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:52.632617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] PATH_INFO: `/v3/users/613b5db28fb44ae1b434b95c24794bfe` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:52.634758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=613b5db28fb44ae1b434b95c24794bfe)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:52.636790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:52.720766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613b5db28fb44ae1b434b95c24794bfe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.730271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613b5db28fb44ae1b434b95c24794bfe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.757114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613b5db28fb44ae1b434b95c24794bfe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.757977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613b5db28fb44ae1b434b95c24794bfe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.796050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613b5db28fb44ae1b434b95c24794bfe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:52.811044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 903/1831] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:52 2022] DELETE /identity/v3/users/613b5db28fb44ae1b434b95c24794bfe => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:53.196920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:53.199168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:53.220507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7164f-a768-4137-bbb2-9147a9442faf admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:53.281583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:53.325709 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:53.327789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:53.383583 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:53.383842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:53.384058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:53.384236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] PATH_INFO: `/v3/projects/5af2c69a27a347a9b44249b4a4962749` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:53.389181 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af2c69a27a347a9b44249b4a4962749)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:53.393451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:53.540668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af2c69a27a347a9b44249b4a4962749', 'request_id': 'req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.551199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af2c69a27a347a9b44249b4a4962749', 'request_id': 'req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.559044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8357f9-51f2-408f-a6e1-2cd0180e6680 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:53.564462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af2c69a27a347a9b44249b4a4962749', 'request_id': 'req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.585461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] The token cache is being invalidate because project 5af2c69a27a347a9b44249b4a4962749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:53.585924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.587511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.594061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 929/1832] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:53 2022] DELETE /identity/v3/projects/5af2c69a27a347a9b44249b4a4962749 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:53.597806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:53.600055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:53.714906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6e4e6-da9f-4443-beac-e6d8ad7af66a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:53.719882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:53.720640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:53.721011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:53.721289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] PATH_INFO: `/v3/users/f82a2bf1e0664668af65cdf7ba3740f5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:53.723744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82a2bf1e0664668af65cdf7ba3740f5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:53.724340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:53.725394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:53.725914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:53.726290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:53.726689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] PATH_INFO: `/v3/users/38d68ed642b8442d93c7936cb467c2e9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:53.728455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d68ed642b8442d93c7936cb467c2e9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:53.733807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:53.748083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:53.844737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82a2bf1e0664668af65cdf7ba3740f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.855580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82a2bf1e0664668af65cdf7ba3740f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.870629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82a2bf1e0664668af65cdf7ba3740f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.871221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82a2bf1e0664668af65cdf7ba3740f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.871335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d68ed642b8442d93c7936cb467c2e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.899965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d68ed642b8442d93c7936cb467c2e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.900733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d68ed642b8442d93c7936cb467c2e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.901433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d68ed642b8442d93c7936cb467c2e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.916434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e3da6738-1afa-4257-be8d-fdc44602a97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d68ed642b8442d93c7936cb467c2e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.918552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:53.921524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b160ebbb-5bc6-4120-8044-6dcec204893d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82a2bf1e0664668af65cdf7ba3740f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:53.936405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 904/1833] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:53 2022] DELETE /identity/v3/users/f82a2bf1e0664668af65cdf7ba3740f5 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:53.942845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:53.943414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:53.943941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 930/1834] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:53 2022] DELETE /identity/v3/users/38d68ed642b8442d93c7936cb467c2e9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:53.947037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:53.947362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:53.947725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:53.948072 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:53.985600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:53.987056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:54.017153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] MFA Rules not processed for user `957cb82c764d478d8a82fb8bb44024f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:54.020291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:54.128292 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 931/1835] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:54.165880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:54.171422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:54.172128 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 905/1836] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:54.180708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:54.183604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:54.201941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c153b-8be4-453e-a83b-88e66b4b5501 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:54.222147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:54.223241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:54.223542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:54.223851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:54.224851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:54.227116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:54.302616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 906/1837] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:54 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:54.307966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:54.336268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490edc-5b3d-4b4e-aa5e-efa6f4bba6f7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:54.489244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:54.489244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:54.489506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:54.489576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:54.522139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:54.527114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6fb5a-3ab1-45e7-8a80-e14e8088c8a6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:54.534370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:54.535327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:54.535837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:54.536759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:54.537761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:54.541114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:54.605771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 907/1838] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:54 2022] POST /identity/v3/users => generated 298 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:54.613917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:54.616369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:54.636316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacac991-d20e-4f67-b39a-2acb1f2653e3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:54.659352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:54.660015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:54.660295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:54.660573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] PATH_INFO: `/v3/projects/7f594161a0db49db9f2afcd12d51c056` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:54.671720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f594161a0db49db9f2afcd12d51c056)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:54.673679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:54.677437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:54.686820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:54.688309 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:54.710905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 932/1839] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:54.716643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:54.730598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3902b-c4ba-4c3c-a13b-998cfea4e42d service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:54.749638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:54.750322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:54.750603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:54.750881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:54.751536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:54.753178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:54.777830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 933/1840] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:54.782458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:54.796471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50615-2d57-462d-95b8-d54d7c671620 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:54.803652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:54.806482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:54.807230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:54.807696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] PATH_INFO: `/v3/projects/3f78ecd7760f4cad902d60ec7f3ddcc3/users/0edd15ac8945456baa95f23db4714490/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:54.828696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f78ecd7760f4cad902d60ec7f3ddcc3, user_id=0edd15ac8945456baa95f23db4714490, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:54.832130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:54.853918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 934/1841] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:54 2022] PUT /identity/v3/projects/3f78ecd7760f4cad902d60ec7f3ddcc3/users/0edd15ac8945456baa95f23db4714490/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:54.858908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:54.865209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f594161a0db49db9f2afcd12d51c056', 'request_id': 'req-7c7057ab-c188-4ae9-ac43-d931da4c3737'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:54.894997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f594161a0db49db9f2afcd12d51c056', 'request_id': 'req-7c7057ab-c188-4ae9-ac43-d931da4c3737'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:54.917374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f594161a0db49db9f2afcd12d51c056', 'request_id': 'req-7c7057ab-c188-4ae9-ac43-d931da4c3737'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:54.947417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] The token cache is being invalidate because project 7f594161a0db49db9f2afcd12d51c056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:54.947729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:54.953140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c7057ab-c188-4ae9-ac43-d931da4c3737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:54.956953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 908/1842] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:54 2022] DELETE /identity/v3/projects/7f594161a0db49db9f2afcd12d51c056 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:54.969718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5da2-868f-4768-8e5a-f1a15456d692 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:54.970049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5da2-868f-4768-8e5a-f1a15456d692 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:54.970338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5da2-868f-4768-8e5a-f1a15456d692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.022319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59476e-9db1-436d-b7fc-2a4b1ad520e0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:55.036091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:55.038840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.039503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.039797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.041719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:55.043552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-26ab5da2-868f-4768-8e5a-f1a15456d692 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:55.044944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-26ab5da2-868f-4768-8e5a-f1a15456d692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:55.045221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:55.078477 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 909/1843] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:55.078699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1258f-13ce-4588-82ef-595ee9ea55c2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.078990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 935/1844] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:55.081080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1258f-13ce-4588-82ef-595ee9ea55c2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.081376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1258f-13ce-4588-82ef-595ee9ea55c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.084288 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:55.087442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:55.125565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4dace-4236-4379-8c21-a4f22846bace admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:55.133774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2ea1258f-13ce-4588-82ef-595ee9ea55c2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:55.135681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2ea1258f-13ce-4588-82ef-595ee9ea55c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:55.138977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:55.143370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.143690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.143980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] PATH_INFO: `/v3/projects/3f78ecd7760f4cad902d60ec7f3ddcc3/users/0edd15ac8945456baa95f23db4714490/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.149900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f78ecd7760f4cad902d60ec7f3ddcc3, user_id=0edd15ac8945456baa95f23db4714490, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:55.161227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:55.171725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 910/1845] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:55.177557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1258f-13ce-4588-82ef-595ee9ea55c2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:55.188092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 936/1846] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:55 2022] PUT /identity/v3/projects/3f78ecd7760f4cad902d60ec7f3ddcc3/users/0edd15ac8945456baa95f23db4714490/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:55.204657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1258f-13ce-4588-82ef-595ee9ea55c2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:55.417214 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:55.417871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.418193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.419741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.423555 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:55.424197 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:55.447694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:55.498460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 911/1847] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:55.503047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:55.526034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3a80-bf80-469f-bc38-a1b9868e4155 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:55.549909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9911f6-c8c6-4360-9433-b85d6dd3c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:55.550593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9911f6-c8c6-4360-9433-b85d6dd3c73a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.550869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9911f6-c8c6-4360-9433-b85d6dd3c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.551826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9911f6-c8c6-4360-9433-b85d6dd3c73a admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.552496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9911f6-c8c6-4360-9433-b85d6dd3c73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:55.554822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9911f6-c8c6-4360-9433-b85d6dd3c73a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:55.611655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 937/1848] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:55 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:55.614396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:55.634033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0e6e-d180-4b3f-a384-f31f3dd895de admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:55.771815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:55.801963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:55.802655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.803023 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.803326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.803974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:55.821949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:55.837545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ccc1-f334-4fc7-8a3c-20024361efde None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.838838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ccc1-f334-4fc7-8a3c-20024361efde None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.839258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ccc1-f334-4fc7-8a3c-20024361efde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.876022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 912/1849] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:55 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:55.880529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:55.881806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7542ccc1-f334-4fc7-8a3c-20024361efde None None] MFA Rules not processed for user `01156595a74941a9933834c824f87952`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:55.882748 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7542ccc1-f334-4fc7-8a3c-20024361efde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:55.907044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c8a09-6e25-4f9d-aaf7-c6347f6c432a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:55.916497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:55.919929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.919929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.920142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:55.920788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:55.929823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:55.957318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 913/1850] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:55.959387 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:55.983014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 938/1851] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:55.986274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ed3e-527c-452f-b8a5-c4c2efe804df admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:55.994698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391aa1-4419-43cf-aec9-01e78e094d48 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:55.995256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391aa1-4419-43cf-aec9-01e78e094d48 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:55.995944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391aa1-4419-43cf-aec9-01e78e094d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.004225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:56.005403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:56.005795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:56.006221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.007657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:56.009599 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:56.024223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-80391aa1-4419-43cf-aec9-01e78e094d48 None None] MFA Rules not processed for user `01156595a74941a9933834c824f87952`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:56.025624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 914/1852] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:56.026033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-80391aa1-4419-43cf-aec9-01e78e094d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:56.026889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:56.036705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 939/1853] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:56.037247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:56.037518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391aa1-4419-43cf-aec9-01e78e094d48 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:56.062400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dec3d3-ff85-4bb3-9b32-edca06801732 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:56.080649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:56.081416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:56.081978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:56.083775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:56.084277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] PATH_INFO: `/v3/projects/9182589cc3074bd9bdc31de6d3ade5fd` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.087021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9182589cc3074bd9bdc31de6d3ade5fd)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:56.089175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391aa1-4419-43cf-aec9-01e78e094d48 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:56.093854 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:56.099571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:56.101446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:56.102128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:56.102677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] PATH_INFO: `/v3/projects/f6e02705bd254ab78d3013044112ebab/users/19300e08f7f0442691365d80626471ba/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.130721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e02705bd254ab78d3013044112ebab, user_id=19300e08f7f0442691365d80626471ba, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:56.134992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:56.163832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 940/1854] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:56 2022] PUT /identity/v3/projects/f6e02705bd254ab78d3013044112ebab/users/19300e08f7f0442691365d80626471ba/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:56.163832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:56.166906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:56.191579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9182589cc3074bd9bdc31de6d3ade5fd', 'request_id': 'req-60a021c8-9def-4404-8b44-7c985115257f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.199682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9182589cc3074bd9bdc31de6d3ade5fd', 'request_id': 'req-60a021c8-9def-4404-8b44-7c985115257f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.210858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9182589cc3074bd9bdc31de6d3ade5fd', 'request_id': 'req-60a021c8-9def-4404-8b44-7c985115257f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.227806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] The token cache is being invalidate because project 9182589cc3074bd9bdc31de6d3ade5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:56.228102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.228794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-60a021c8-9def-4404-8b44-7c985115257f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.232896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 915/1855] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:56 2022] DELETE /identity/v3/projects/9182589cc3074bd9bdc31de6d3ade5fd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:56.234774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:56.234774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:56.234774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.270898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f934-91fa-44fa-9faa-da767bde3c3b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:56.273094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] MFA Rules not processed for user `19300e08f7f0442691365d80626471ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:56.274922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:56.378682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:56.379554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:56.380024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:56.380831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.382994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:56.466649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 916/1856] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:56.468185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:56.469666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:56.495507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:56.499207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:56.513590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 941/1857] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:56.527831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:56.530947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:56.570352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:56.577496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:56.679519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c98e7-5a03-4ff8-95e3-e0aa02675e7f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:56.685495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:56.686959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:56.687249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:56.687528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] PATH_INFO: `/v3/users/87452c4f6d61473492a41fe56420f4d2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.689953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=87452c4f6d61473492a41fe56420f4d2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:56.691939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:56.698739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb0e6d-5291-4ec9-9b8f-2d794c131d98 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:56.707182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:56.707803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:56.708082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:56.708354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:56.708996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:56.711141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:56.767889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 942/1858] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:56 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:56.773033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:56.822944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87452c4f6d61473492a41fe56420f4d2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.845250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87452c4f6d61473492a41fe56420f4d2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.865894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87452c4f6d61473492a41fe56420f4d2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.866884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87452c4f6d61473492a41fe56420f4d2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.892048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87452c4f6d61473492a41fe56420f4d2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:56.910863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 917/1859] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:56 2022] DELETE /identity/v3/users/87452c4f6d61473492a41fe56420f4d2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:56.937622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660b74b-0dde-4d73-859a-86c075ca1ced admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.037655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.038526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.038948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.039198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.039944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.042234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.083272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 943/1860] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:56 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:57.085145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.087134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:57.116130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c174af-0a94-4622-ba0c-752cdf7717fe admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.124499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.125696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.126228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.126707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.127633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.129688 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.149997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 918/1861] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:57.150994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.165859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106ef5-4f65-4523-aaaa-b1f8609cf091 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.177790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6da992-b1ff-4f63-8ce2-16efa8ac0822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.179269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da992-b1ff-4f63-8ce2-16efa8ac0822 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.179590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da992-b1ff-4f63-8ce2-16efa8ac0822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.179867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da992-b1ff-4f63-8ce2-16efa8ac0822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.180533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6da992-b1ff-4f63-8ce2-16efa8ac0822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.187722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6da992-b1ff-4f63-8ce2-16efa8ac0822 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.222918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 944/1862] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:57.223206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.237831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f1bd-46ec-40f6-8a85-93f1a66b4970 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.252648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.253315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.253560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.253884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] PATH_INFO: `/v3/projects/8df4c964702b4079bf63c2489058102b/users/f4f032ea16da467c8a704f97de89e8e1/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.286619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df4c964702b4079bf63c2489058102b, user_id=f4f032ea16da467c8a704f97de89e8e1, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.290318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.319795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 919/1863] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:57 2022] PUT /identity/v3/projects/8df4c964702b4079bf63c2489058102b/users/f4f032ea16da467c8a704f97de89e8e1/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:57.321471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296695-0478-4fbf-9217-56d3a4503433 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.322011 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296695-0478-4fbf-9217-56d3a4503433 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.322793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47296695-0478-4fbf-9217-56d3a4503433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.391852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-47296695-0478-4fbf-9217-56d3a4503433 None None] MFA Rules not processed for user `f4f032ea16da467c8a704f97de89e8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:57.392953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-47296695-0478-4fbf-9217-56d3a4503433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:57.407227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.411057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:57.452899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:57.516967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24f66-0279-4741-a5db-5ad5667ba0c9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.527619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.529244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.529716 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.530404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] PATH_INFO: `/v3/projects/acbfae9d0ee341c789c4997a724951a3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.533305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbfae9d0ee341c789c4997a724951a3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.540295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.546232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 945/1864] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:57.550357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47296695-0478-4fbf-9217-56d3a4503433 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.563924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47296695-0478-4fbf-9217-56d3a4503433 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.568873 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:57.569956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.570906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.571191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.571465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.572483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.574562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.625559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 946/1865] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:57 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:57.630521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.643424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbfae9d0ee341c789c4997a724951a3', 'request_id': 'req-018e9409-78e9-466b-a250-7c1644b74bc7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:57.651882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbfae9d0ee341c789c4997a724951a3', 'request_id': 'req-018e9409-78e9-466b-a250-7c1644b74bc7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:57.663546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbfae9d0ee341c789c4997a724951a3', 'request_id': 'req-018e9409-78e9-466b-a250-7c1644b74bc7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:57.689322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] The token cache is being invalidate because project acbfae9d0ee341c789c4997a724951a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:06:57.689932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:57.693562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-018e9409-78e9-466b-a250-7c1644b74bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:06:57.700917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 920/1866] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:06:57 2022] DELETE /identity/v3/projects/acbfae9d0ee341c789c4997a724951a3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:57.705656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f03606-62b8-4f73-8b69-a817d724ef77 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.705948 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f03606-62b8-4f73-8b69-a817d724ef77 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.706661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f03606-62b8-4f73-8b69-a817d724ef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.740176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b367-8fe9-4f9a-af3f-a73392fc7dd0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.746331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.747126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.747573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.748260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.748917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.751567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.754232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d3f03606-62b8-4f73-8b69-a817d724ef77 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:57.759154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d3f03606-62b8-4f73-8b69-a817d724ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:57.787013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 947/1867] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:57 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:57.788305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 921/1868] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:57.788424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.792681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:57.798310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9f44-4562-4989-b2e7-b3fbcdb96787 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.798812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9f44-4562-4989-b2e7-b3fbcdb96787 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.799239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9f44-4562-4989-b2e7-b3fbcdb96787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.807308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804e82-4ef2-459b-8156-ccef336f4442 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.819639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.820565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.820855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.821134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.821787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.823833 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.827318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-78cb9f44-4562-4989-b2e7-b3fbcdb96787 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:57.828598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-78cb9f44-4562-4989-b2e7-b3fbcdb96787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:57.840925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 948/1869] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:57.842368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.844271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 922/1870] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:57.852176 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb9f44-4562-4989-b2e7-b3fbcdb96787 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.854841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df872b-603b-476d-9fe6-48aa8c7ac04a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.862205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.863214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.863590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.864466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] PATH_INFO: `/v3/projects/4f0f84948b534b3e8fabae3673e951db/users/ad4e271361c04c9e9eb4d27df0360a9f/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.877245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb9f44-4562-4989-b2e7-b3fbcdb96787 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:57.881987 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0f84948b534b3e8fabae3673e951db, user_id=ad4e271361c04c9e9eb4d27df0360a9f, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.884753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.888822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:57.889682 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:57.890019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:57.890353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:57.891119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:06:57.891424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:57.893229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:57.911311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 923/1871] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:06:57.914145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 949/1872] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:57 2022] PUT /identity/v3/projects/4f0f84948b534b3e8fabae3673e951db/users/ad4e271361c04c9e9eb4d27df0360a9f/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:57.917197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.917345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:57.931568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbae4c-0e42-4cd4-98ff-5c38c89042c3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.017282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:58.058688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287034a-1eb4-4c1e-a351-d92fba8deb41 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.066867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.067952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.068382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.068807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.069800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.072566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.079533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a112f2-b93b-4134-a19c-6bd477cf0458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.080264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a112f2-b93b-4134-a19c-6bd477cf0458 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.080646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a112f2-b93b-4134-a19c-6bd477cf0458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.081136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a112f2-b93b-4134-a19c-6bd477cf0458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.081879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a112f2-b93b-4134-a19c-6bd477cf0458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.092872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 950/1873] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:58.098541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:58.110135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a112f2-b93b-4134-a19c-6bd477cf0458 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.115000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7870602-96f5-47ac-aa12-196c98c978a5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.121240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25d469-7492-4836-891b-1ccf150e7032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.122610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25d469-7492-4836-891b-1ccf150e7032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.124118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25d469-7492-4836-891b-1ccf150e7032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.124551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25d469-7492-4836-891b-1ccf150e7032 admin admin] PATH_INFO: `/v3/projects/4f0f84948b534b3e8fabae3673e951db/users/ad4e271361c04c9e9eb4d27df0360a9f/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.126917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25d469-7492-4836-891b-1ccf150e7032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0f84948b534b3e8fabae3673e951db, user_id=ad4e271361c04c9e9eb4d27df0360a9f, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.143247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25d469-7492-4836-891b-1ccf150e7032 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.178430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 951/1874] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:58 2022] PUT /identity/v3/projects/4f0f84948b534b3e8fabae3673e951db/users/ad4e271361c04c9e9eb4d27df0360a9f/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:58.179647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9ed08-bdd4-48c0-926c-be7d796e2b50 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.179940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9ed08-bdd4-48c0-926c-be7d796e2b50 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.180242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9ed08-bdd4-48c0-926c-be7d796e2b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.208004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 924/1875] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:57 2022] POST /identity/v3/projects => generated 377 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:58.210432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.210837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.211330 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.230972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a6e9ed08-bdd4-48c0-926c-be7d796e2b50 None None] MFA Rules not processed for user `01156595a74941a9933834c824f87952`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:58.233416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a6e9ed08-bdd4-48c0-926c-be7d796e2b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:58.292065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] MFA Rules not processed for user `ad4e271361c04c9e9eb4d27df0360a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:58.293439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:58.334431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 952/1876] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:58.335806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9ed08-bdd4-48c0-926c-be7d796e2b50 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:58.441531 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:58.480306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 925/1877] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:06:58.491788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:58.497857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:58.508018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9ed08-bdd4-48c0-926c-be7d796e2b50 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.548633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.550378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.550834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.551869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.552781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.555066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.610747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 953/1878] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:58 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:58.610747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:58.635675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30857071-28b5-48c7-b763-088678bd285a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.637134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edeb60-d121-4c6a-b39d-7f959717463d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.643577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.645544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.646295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.646810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.647866 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.648538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.648766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.649042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.649705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.651350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.668127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.671661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.686172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 954/1879] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:58.687261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:58.698275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb895-841c-4114-ada4-a5f010cfe4bb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.706794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 926/1880] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:06:58.725141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.725779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.726030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.726330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.726983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.728591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.774695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:58.776395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:58.777437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 955/1881] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:58.782710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:58.795662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3181169-bafc-46c6-a4dc-81b15876491a service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.805303 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf304ff-b7f6-45a1-8b06-dd9b167f5f32 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:58.807608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.808496 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.808976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.810037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.814929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:58.815916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c2b9a-da13-4b08-b1ce-395c72322350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:58.816623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2b9a-da13-4b08-b1ce-395c72322350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.816905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2b9a-da13-4b08-b1ce-395c72322350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.817182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c2b9a-da13-4b08-b1ce-395c72322350 admin admin] PATH_INFO: `/v3/projects/0231090a09e246fc8087114f3c13bf61/users/5aee209e1cae42b79931a29c97bf1664/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.850766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c2b9a-da13-4b08-b1ce-395c72322350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0231090a09e246fc8087114f3c13bf61, user_id=5aee209e1cae42b79931a29c97bf1664, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.853671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c2b9a-da13-4b08-b1ce-395c72322350 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.880113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 956/1882] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:58 2022] PUT /identity/v3/projects/0231090a09e246fc8087114f3c13bf61/users/5aee209e1cae42b79931a29c97bf1664/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:06:58.891017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94acd8f-e375-4cd4-9161-de3eb5045fd1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:58.891305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94acd8f-e375-4cd4-9161-de3eb5045fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:58.891593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94acd8f-e375-4cd4-9161-de3eb5045fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:58.963306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c94acd8f-e375-4cd4-9161-de3eb5045fd1 None None] MFA Rules not processed for user `5aee209e1cae42b79931a29c97bf1664`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:06:58.966412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c94acd8f-e375-4cd4-9161-de3eb5045fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:58.968122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:58.969838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:58.986251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 927/1883] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:06:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:06:59.000847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:59.138031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 957/1884] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:06:59.142226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:59.176970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9959-2a7b-4624-bfc9-452a5c224d04 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:59.372474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:59.373187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:59.373442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:59.373665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:59.374448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:59.376460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:59.433877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 928/1885] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:06:59 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:06:59.438021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94acd8f-e375-4cd4-9161-de3eb5045fd1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:59.457083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94acd8f-e375-4cd4-9161-de3eb5045fd1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:59.604911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:59.606275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:59.606736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:59.607166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:59.608456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:59.610909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:59.650882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 958/1886] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:06:59 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:06:59.652897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:59.669445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237287-77b0-4884-969b-c3db731adb26 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:59.681756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:59.682668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:59.682823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:59.683774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:59.686313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:59.689757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:59.709152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 929/1887] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:59.713502 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:59.737264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22e8f0-6ead-41a4-a4c3-7ea078608e2b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:59.753165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:59.753917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:59.754984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:59.755382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:59.756229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:59.758459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:59.777783 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 959/1888] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:06:59.780218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:59.790442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:06:59.806727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2779c6-20dd-4ea4-9099-405216282d8a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:59.815606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:06:59.817348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:06:59.820378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f931b1-550e-4e5a-8c7b-59059bc4c2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:59.822471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f931b1-550e-4e5a-8c7b-59059bc4c2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:59.822895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f931b1-550e-4e5a-8c7b-59059bc4c2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:59.823473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f931b1-550e-4e5a-8c7b-59059bc4c2b7 admin admin] PATH_INFO: `/v3/projects/8959500ed2af4377a16d78446ae95f20/users/50cbf3ae3086497881595b704e8c8023/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:59.835477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975032-94f0-4a73-bca1-c7d175cc9b12 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:06:59.848750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:06:59.849415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:59.849697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:59.849972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] PATH_INFO: `/v3/users/7251762bc1124518b8c50e5acc808cd4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:59.851880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7251762bc1124518b8c50e5acc808cd4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:59.854260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:59.877088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f931b1-550e-4e5a-8c7b-59059bc4c2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8959500ed2af4377a16d78446ae95f20, user_id=50cbf3ae3086497881595b704e8c8023, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:06:59.880429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f931b1-550e-4e5a-8c7b-59059bc4c2b7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:06:59.921481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 930/1889] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:06:59 2022] PUT /identity/v3/projects/8959500ed2af4377a16d78446ae95f20/users/50cbf3ae3086497881595b704e8c8023/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:06:59.926308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:06:59.926550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:06:59.926864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:06:59.977595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7251762bc1124518b8c50e5acc808cd4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:00.002543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7251762bc1124518b8c50e5acc808cd4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:00.005123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7251762bc1124518b8c50e5acc808cd4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:00.006147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7251762bc1124518b8c50e5acc808cd4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:00.015322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] MFA Rules not processed for user `50cbf3ae3086497881595b704e8c8023`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:00.016567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:00.040426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3550741e-8941-4dcb-b72d-23474040b980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7251762bc1124518b8c50e5acc808cd4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:00.074287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:00.099161 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 960/1890] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:06:59 2022] DELETE /identity/v3/users/7251762bc1124518b8c50e5acc808cd4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:00.104557 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:00.104865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:00.107213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:00.210059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:00.214818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:00.217941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 931/1891] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:00.219640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:00.222823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:00.456463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe24250-430f-4aec-b314-ff33b42b75b2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:00.466791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:00.467527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:00.469693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:00.470056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:00.470928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:00.477112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:00.477347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 961/1892] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:00.558578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:00.562052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:00.583810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 932/1893] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:07:00 2022] POST /identity/v3/projects => generated 377 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:00.592835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:00.694326 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2857fe-649c-4845-a543-266308c315f2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:00.816002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:00.820761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:00.824043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:00.824738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:00.826436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:00.844025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e013-0e17-4c4c-9a52-400d9175000b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:00.859412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:00.862433 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:00.862889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:00.863294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:00.865031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:00.865321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:00.867251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:00.870905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:00.888480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 962/1894] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:07:00.981806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 933/1895] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:07:00 2022] POST /identity/v3/users => generated 295 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:00.985842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:01.005567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607947-0281-46ac-92e2-a93c580f24f3 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:01.025132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:01.025929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:01.026250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:01.026528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:01.027282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:01.040822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:01.080086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 963/1896] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:01.084400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:01.102706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e2aed-f002-4c2d-9d3b-e72156be6a8b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:01.120192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:01.121363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:01.121363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:01.127749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] PATH_INFO: `/v3/projects/466323a8b93a42cf9e226dd5206d9041/users/6399c929fc05441886fb49444d4120b7/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:01.173410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466323a8b93a42cf9e226dd5206d9041, user_id=6399c929fc05441886fb49444d4120b7, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:01.176431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:01.235114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 934/1897] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:07:01 2022] PUT /identity/v3/projects/466323a8b93a42cf9e226dd5206d9041/users/6399c929fc05441886fb49444d4120b7/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:01.238005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:01.265106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516059a-b65e-44db-8709-7f898b65705f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:01.355570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:01.372981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302ca4f-9f65-47fa-b7d7-33ce5fd9056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:01.373938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302ca4f-9f65-47fa-b7d7-33ce5fd9056d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:01.374449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302ca4f-9f65-47fa-b7d7-33ce5fd9056d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:01.375153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302ca4f-9f65-47fa-b7d7-33ce5fd9056d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:01.375830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302ca4f-9f65-47fa-b7d7-33ce5fd9056d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:01.377480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302ca4f-9f65-47fa-b7d7-33ce5fd9056d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:01.409095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 964/1898] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:01.410286 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:01.425513 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7fb9d-9c36-4ce9-ba68-8832476a8ea3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:01.437756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:01.438534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:01.439112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:01.440324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] PATH_INFO: `/v3/projects/466323a8b93a42cf9e226dd5206d9041/users/6399c929fc05441886fb49444d4120b7/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:01.446619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466323a8b93a42cf9e226dd5206d9041, user_id=6399c929fc05441886fb49444d4120b7, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:01.462630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:01.494594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 935/1899] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:07:01 2022] PUT /identity/v3/projects/466323a8b93a42cf9e226dd5206d9041/users/6399c929fc05441886fb49444d4120b7/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:07:01.508103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:01.508444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:01.508738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:01.559682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] MFA Rules not processed for user `6399c929fc05441886fb49444d4120b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:01.567528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:01.735819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 965/1900] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:01.748557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:01.751712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:01.928766 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911aa3-9f6f-410a-b71f-17304db970a4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:01.933609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:01.935543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:01.936568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:01.936992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:01.947744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:02.102997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:02.107547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:02.121048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 936/1901] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:02.863340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:02.865992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:02.932360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:02.947209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:03.226907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5385-667d-401b-94c1-4ae0d40d85ef service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:03.245073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:03.247084 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:03.247499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:03.247980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] PATH_INFO: `/v3/projects/70585b2849c844929416449e41126bc5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:03.249273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b964cb-f0f7-4cea-891d-de52196a27b4 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:03.250136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70585b2849c844929416449e41126bc5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:03.254833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:03.265154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:03.271270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:03.272364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:03.272776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:03.273221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] PATH_INFO: `/v3/users/19300e08f7f0442691365d80626471ba` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:03.277521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=19300e08f7f0442691365d80626471ba)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:03.285551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:03.383567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70585b2849c844929416449e41126bc5', 'request_id': 'req-1050096b-318f-4ced-84eb-931d289485f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.400161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70585b2849c844929416449e41126bc5', 'request_id': 'req-1050096b-318f-4ced-84eb-931d289485f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.425839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70585b2849c844929416449e41126bc5', 'request_id': 'req-1050096b-318f-4ced-84eb-931d289485f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.444360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19300e08f7f0442691365d80626471ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.454311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] The token cache is being invalidate because project 70585b2849c844929416449e41126bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:03.454673 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.456629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1050096b-318f-4ced-84eb-931d289485f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.460016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 937/1902] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:02 2022] DELETE /identity/v3/projects/70585b2849c844929416449e41126bc5 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:03.468034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb268-fdcb-41ba-a583-a92527686937 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:03.468034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb268-fdcb-41ba-a583-a92527686937 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:03.468034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfb268-fdcb-41ba-a583-a92527686937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:03.492776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19300e08f7f0442691365d80626471ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.493739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19300e08f7f0442691365d80626471ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.495611 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19300e08f7f0442691365d80626471ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.521508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6ecfb268-fdcb-41ba-a583-a92527686937 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:03.522743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6ecfb268-fdcb-41ba-a583-a92527686937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:03.523121 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-45cc060f-5b5e-4cdf-be14-fd97910157ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19300e08f7f0442691365d80626471ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:03.527190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:03.569677 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 966/1903] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:02 2022] DELETE /identity/v3/users/19300e08f7f0442691365d80626471ba => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:07:03.575955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49e83-1fd9-4f52-9d23-ed2c360d12bb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:03.576434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49e83-1fd9-4f52-9d23-ed2c360d12bb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:03.576918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49e83-1fd9-4f52-9d23-ed2c360d12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:03.650510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 938/1904] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:07:03.653280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7247-1723-4cb4-a9e5-cc71cb41a579 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:03.653577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7247-1723-4cb4-a9e5-cc71cb41a579 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:03.653867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7247-1723-4cb4-a9e5-cc71cb41a579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:03.682623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a2c49e83-1fd9-4f52-9d23-ed2c360d12bb None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:03.687262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a2c49e83-1fd9-4f52-9d23-ed2c360d12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:03.703314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fb4e7247-1723-4cb4-a9e5-cc71cb41a579 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:03.705308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fb4e7247-1723-4cb4-a9e5-cc71cb41a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:03.852544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 939/1905] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:03.854909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7247-1723-4cb4-a9e5-cc71cb41a579 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:03.880971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7247-1723-4cb4-a9e5-cc71cb41a579 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:03.896829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:03.897482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:03.897770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:03.898354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:03.898969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:07:03.899282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:03.900905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:03.926926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 967/1906] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:03.934550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 940/1907] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:07:03.936874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49e83-1fd9-4f52-9d23-ed2c360d12bb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:03.961478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:03.966806 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:03.975334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49e83-1fd9-4f52-9d23-ed2c360d12bb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:03.993463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.001137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.001672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.002203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.006440 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:04.016404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:04.056463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:04.076417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 968/1908] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:07:03 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:04.083616 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:04.221623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0e52e-62fd-44b8-a803-ab334b7b8ee5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:04.241235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb102-ab85-4d81-ad6d-0ddd897b226f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:04.246109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.248321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.248609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.249025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.249979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:04.252043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:04.287010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 969/1909] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:07:04 2022] POST /identity/v3/users => generated 282 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:04.291024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:04.313852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1c1d8-f3b2-49f4-8266-3cf6719fafd8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:04.330120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.330120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.330664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.330664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.331563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:04.333382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:04.354610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.362906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.362906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.362906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.363142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 970/1910] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:04.363142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:04.381160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:04.382264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:04.396430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03756fc4-7523-458c-84bd-042169cfbfae admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:04.409214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.409834 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.410129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.410403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.414037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:04.421372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:04.429291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 941/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:07:04.461029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 971/1912] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:07:04.461339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:04.470133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f199f33-0b70-4bdb-b2bc-ef9854f64e3a service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:04.486769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278929fa-9e60-4df8-a9af-921806543301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.487467 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278929fa-9e60-4df8-a9af-921806543301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.487751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278929fa-9e60-4df8-a9af-921806543301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.490561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278929fa-9e60-4df8-a9af-921806543301 admin admin] PATH_INFO: `/v3/projects/22f929c6f11b4e97b736f54cad83673a/users/959fd6123e39486ea317dd5a85e0e137/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.562792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278929fa-9e60-4df8-a9af-921806543301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f929c6f11b4e97b736f54cad83673a, user_id=959fd6123e39486ea317dd5a85e0e137, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:04.569107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278929fa-9e60-4df8-a9af-921806543301 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:04.610515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:04.612842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:04.636223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 942/1913] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:07:04 2022] PUT /identity/v3/projects/22f929c6f11b4e97b736f54cad83673a/users/959fd6123e39486ea317dd5a85e0e137/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:04.650788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.651378 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.651867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.720079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] MFA Rules not processed for user `959fd6123e39486ea317dd5a85e0e137`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:04.721313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:04.725505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:04.787725 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a745-a660-4ca6-a9f7-a432e0d63147 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:04.876584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 943/1914] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:07:04.889138 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:04.890615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:04.908826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.909450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.909827 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.910237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:04.912210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:04.972938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:04.988977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12b00f-0e4c-4448-8e9d-d0e00e2ee8a4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:04.992995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:04.993657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:04.993939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:04.994244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:05.006746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:05.008725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:05.021818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 944/1915] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:07:05.094935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:05.096869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:05.124370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 972/1916] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:05.626774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:05.629262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:05.840999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe4cd8-e0f2-4d34-bc3d-5bbec18d438f service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:05.849301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:05.850392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:05.851697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:05.852594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] PATH_INFO: `/v3/projects/f6e02705bd254ab78d3013044112ebab` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:05.855042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e02705bd254ab78d3013044112ebab)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:05.860640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:05.998889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e02705bd254ab78d3013044112ebab', 'request_id': 'req-ad00f872-cf4a-4f59-bcf5-999ae0864209'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.026348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e02705bd254ab78d3013044112ebab', 'request_id': 'req-ad00f872-cf4a-4f59-bcf5-999ae0864209'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.062995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e02705bd254ab78d3013044112ebab', 'request_id': 'req-ad00f872-cf4a-4f59-bcf5-999ae0864209'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.099567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] The token cache is being invalidate because project f6e02705bd254ab78d3013044112ebab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:06.100244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.101426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.104291 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 945/1917] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:05 2022] DELETE /identity/v3/projects/f6e02705bd254ab78d3013044112ebab => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:06.109358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:06.134390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1245c6-d144-4280-be6a-dd9b838777a6 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:06.174586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:06.176867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:06.258327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:06.259308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:06.259594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:06.259871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] PATH_INFO: `/v3/users/f4f032ea16da467c8a704f97de89e8e1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:06.261788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f032ea16da467c8a704f97de89e8e1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:06.264212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:06.264679 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00f872-cf4a-4f59-bcf5-999ae0864209 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:06.270194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df391a-ba3d-402b-b555-10d8d9cb7c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:06.270817 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df391a-ba3d-402b-b555-10d8d9cb7c3f service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:06.271099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df391a-ba3d-402b-b555-10d8d9cb7c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:06.271547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df391a-ba3d-402b-b555-10d8d9cb7c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:06.273793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-97df391a-ba3d-402b-b555-10d8d9cb7c3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:06.320922 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:06.329051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f032ea16da467c8a704f97de89e8e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.330964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:06.351418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f032ea16da467c8a704f97de89e8e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.352788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f032ea16da467c8a704f97de89e8e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.353751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f032ea16da467c8a704f97de89e8e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.366419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f032ea16da467c8a704f97de89e8e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:06.384175 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df391a-ba3d-402b-b555-10d8d9cb7c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:06.387789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df391a-ba3d-402b-b555-10d8d9cb7c3f service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:06.397575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 973/1918] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:06 2022] DELETE /identity/v3/users/f4f032ea16da467c8a704f97de89e8e1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:06.407363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 946/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:07:07.389386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:07.390913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:07.554361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40490-58d8-4dd3-b2b3-c0a57bbe953a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:07.561904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:07.562974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:07.563752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:07.567781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:07.568615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:07.569125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:07.569652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] PATH_INFO: `/v3/projects/8df4c964702b4079bf63c2489058102b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:07.571799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df4c964702b4079bf63c2489058102b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:07.577064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:07.674642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] MFA Rules not processed for user `0edd15ac8945456baa95f23db4714490`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:07.677516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:07.722107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df4c964702b4079bf63c2489058102b', 'request_id': 'req-22cc89a4-5c39-41ef-a66c-e6599f767146'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:07.738307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df4c964702b4079bf63c2489058102b', 'request_id': 'req-22cc89a4-5c39-41ef-a66c-e6599f767146'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:07.751409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df4c964702b4079bf63c2489058102b', 'request_id': 'req-22cc89a4-5c39-41ef-a66c-e6599f767146'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:07.776521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] The token cache is being invalidate because project 8df4c964702b4079bf63c2489058102b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:07.776830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:07.778820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:07.799433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 974/1920] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:07 2022] DELETE /identity/v3/projects/8df4c964702b4079bf63c2489058102b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:07.799648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:07.806192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:07.896289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 947/1921] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:07.911849 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:07.914019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:08.006645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:08.039526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc89a4-5c39-41ef-a66c-e6599f767146 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:08.055264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f46ab-2551-4b56-9ec5-c3830d0f3d6d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:08.063903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:08.064599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:08.065021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:08.065343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] PATH_INFO: `/v3/users/ad4e271361c04c9e9eb4d27df0360a9f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:08.066837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4e271361c04c9e9eb4d27df0360a9f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:08.069447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:08.085492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:08.087710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:08.088448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:08.090504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:08.096325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:08.233893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4e271361c04c9e9eb4d27df0360a9f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:08.280415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4e271361c04c9e9eb4d27df0360a9f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:08.281198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4e271361c04c9e9eb4d27df0360a9f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:08.282016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4e271361c04c9e9eb4d27df0360a9f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:08.310536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b54eeae2-e0e6-4b51-8a51-20ed752d55d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4e271361c04c9e9eb4d27df0360a9f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:08.338532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 975/1922] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:07 2022] DELETE /identity/v3/users/ad4e271361c04c9e9eb4d27df0360a9f => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:08.380047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:08.385013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:08.429632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 948/1923] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:07:08.708205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:08.708981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:08.709219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:08.741697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:08.744009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:08.857890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 976/1924] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:08.909659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:08.942190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:08.944864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:08.947075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd6707-73ff-42c9-999b-a5e82f0f0577 service glance] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:08.958742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:09.056504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1c225-cef6-4437-b44b-d095b3ef06c7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:09.063993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc9ab4-d2fa-4327-8859-ff2e25ac0f69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:09.065291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc9ab4-d2fa-4327-8859-ff2e25ac0f69 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:09.065830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc9ab4-d2fa-4327-8859-ff2e25ac0f69 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:09.065962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:09.066468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc9ab4-d2fa-4327-8859-ff2e25ac0f69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:09.066614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:09.066862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:09.067459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] PATH_INFO: `/v3/projects/4f0f84948b534b3e8fabae3673e951db` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:09.068960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0f84948b534b3e8fabae3673e951db)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:09.071901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:09.080045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc9ab4-d2fa-4327-8859-ff2e25ac0f69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:09.081898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc9ab4-d2fa-4327-8859-ff2e25ac0f69 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:09.093320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 977/1925] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:07:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:07:09.161999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0f84948b534b3e8fabae3673e951db', 'request_id': 'req-378576b8-81e6-4870-a9c5-6f4b2f35b554'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:09.171043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0f84948b534b3e8fabae3673e951db', 'request_id': 'req-378576b8-81e6-4870-a9c5-6f4b2f35b554'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:09.190068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0f84948b534b3e8fabae3673e951db', 'request_id': 'req-378576b8-81e6-4870-a9c5-6f4b2f35b554'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:09.205830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] The token cache is being invalidate because project 4f0f84948b534b3e8fabae3673e951db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:09.206162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:09.207230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-378576b8-81e6-4870-a9c5-6f4b2f35b554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:09.213417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 949/1926] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:08 2022] DELETE /identity/v3/projects/4f0f84948b534b3e8fabae3673e951db => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:09.215135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12403a-b033-4f02-8d7c-5037b1b529a9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:09.215593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12403a-b033-4f02-8d7c-5037b1b529a9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:09.215880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12403a-b033-4f02-8d7c-5037b1b529a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:09.366007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ef12403a-b033-4f02-8d7c-5037b1b529a9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:09.366850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ef12403a-b033-4f02-8d7c-5037b1b529a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:09.388780 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:09.541133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 978/1927] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:09.548107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1e4f8-d5e9-46d5-84d9-d4c3ffa6e028 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:09.548686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1e4f8-d5e9-46d5-84d9-d4c3ffa6e028 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:09.549177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1e4f8-d5e9-46d5-84d9-d4c3ffa6e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:09.594107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-19c1e4f8-d5e9-46d5-84d9-d4c3ffa6e028 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:09.597562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-19c1e4f8-d5e9-46d5-84d9-d4c3ffa6e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:09.620175 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 950/1928] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:09.625441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12403a-b033-4f02-8d7c-5037b1b529a9 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:09.640729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12403a-b033-4f02-8d7c-5037b1b529a9 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:09.653036 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:09.653835 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:09.654213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:09.654554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:09.657241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:07:09.657241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:09.660250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:09.682489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 979/1929] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:07:09.683661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1e4f8-d5e9-46d5-84d9-d4c3ffa6e028 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:09.697644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1e4f8-d5e9-46d5-84d9-d4c3ffa6e028 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:09.722245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:09.722862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:09.723184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:09.723461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:09.724162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:09.726235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:09.798336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 951/1930] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:07:09 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:09.802118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:09.817379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c217a99-2e9e-4b80-aa88-c06d44e80fe0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:10.017309 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:10.018294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:10.018722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:10.019135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:10.020061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:10.024944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:10.093700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 980/1931] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:07:09 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:10.097801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:10.135204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f2ed-16cc-44de-82f0-a3e152a8d55d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:10.141470 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:10.142382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:10.142845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:10.143296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:10.144651 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:10.146522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:10.165052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:10.165973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 952/1932] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:10.177240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98f19-e8dc-45d2-be95-8f8f435c63b5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:10.193637 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658655c-eba3-4390-904c-f5cb6f256288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:10.197971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658655c-eba3-4390-904c-f5cb6f256288 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:10.198301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658655c-eba3-4390-904c-f5cb6f256288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:10.198581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658655c-eba3-4390-904c-f5cb6f256288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:10.206438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658655c-eba3-4390-904c-f5cb6f256288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:10.210429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658655c-eba3-4390-904c-f5cb6f256288 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:10.243648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 981/1933] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:07:10.248691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:10.269043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792a5dd-919d-4290-a940-d4164d6f1c78 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:10.280434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:10.281570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:10.281909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:10.282366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] PATH_INFO: `/v3/projects/283d2fe25196411093d05d704b45cf68/users/12e705bc45a54e7a948a4ac36d9e0e86/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:10.331295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=283d2fe25196411093d05d704b45cf68, user_id=12e705bc45a54e7a948a4ac36d9e0e86, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:10.335491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:10.361984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 953/1934] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:07:10 2022] PUT /identity/v3/projects/283d2fe25196411093d05d704b45cf68/users/12e705bc45a54e7a948a4ac36d9e0e86/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:07:10.373515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:10.373806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:10.374113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:10.457731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] MFA Rules not processed for user `12e705bc45a54e7a948a4ac36d9e0e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:10.460352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:10.572885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 982/1935] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:07:10.590560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:10.597112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:10.712346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:10.763104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829f8e1-dd79-4549-b939-5b4338b378ba admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:10.769591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b08f41-2b16-4162-9520-69b53c6ead6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:10.770377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b08f41-2b16-4162-9520-69b53c6ead6d service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:10.770757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b08f41-2b16-4162-9520-69b53c6ead6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:10.771129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b08f41-2b16-4162-9520-69b53c6ead6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:10.789415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b08f41-2b16-4162-9520-69b53c6ead6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:10.790910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b08f41-2b16-4162-9520-69b53c6ead6d service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:10.814635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 954/1936] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:11.713407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:11.714852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:11.723273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:11.913885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762a8d-dfd0-4bb5-a861-fa45b9de2d61 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:11.929757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:11.932042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:11.932400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:11.932957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] PATH_INFO: `/v3/users/5aee209e1cae42b79931a29c97bf1664` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:11.937086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aee209e1cae42b79931a29c97bf1664)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:11.944073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:12.035568 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aee209e1cae42b79931a29c97bf1664'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:12.059566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aee209e1cae42b79931a29c97bf1664'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:12.060481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aee209e1cae42b79931a29c97bf1664'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:12.061558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aee209e1cae42b79931a29c97bf1664'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:12.086022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aee209e1cae42b79931a29c97bf1664'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:12.145477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 983/1937] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:11 2022] DELETE /identity/v3/users/5aee209e1cae42b79931a29c97bf1664 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:12.150196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:12.151062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:12.151512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:12.200141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:12.201671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:12.337834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 955/1938] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:12.357635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:12.361175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:12.504067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5346657-1bb4-43c5-a3ba-b082a0073fc9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:12.511808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:12.513746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:12.514788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:12.515178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:12.531309 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:12.533314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:12.560431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 984/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:14.335622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:14.339838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:14.367130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b40439-0550-4038-9d59-ec32c4540807 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:14.395603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:14.396646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:14.397159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:14.397674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] PATH_INFO: `/v3/projects/0231090a09e246fc8087114f3c13bf61` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:14.399458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0231090a09e246fc8087114f3c13bf61)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:14.402032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:14.592113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0231090a09e246fc8087114f3c13bf61', 'request_id': 'req-20fb09a9-e56e-4c1c-8152-a546ffda20cb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:14.615408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0231090a09e246fc8087114f3c13bf61', 'request_id': 'req-20fb09a9-e56e-4c1c-8152-a546ffda20cb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:14.631720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0231090a09e246fc8087114f3c13bf61', 'request_id': 'req-20fb09a9-e56e-4c1c-8152-a546ffda20cb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:14.658289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] The token cache is being invalidate because project 0231090a09e246fc8087114f3c13bf61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:14.658628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:14.660412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:14.665567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 956/1940] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:14 2022] DELETE /identity/v3/projects/0231090a09e246fc8087114f3c13bf61 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:14.669822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:14.698158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907c496-7c6b-470d-bccb-c62d4cc09753 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:14.789952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:14.889645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:14.890659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:14.893212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:14.893212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] PATH_INFO: `/v3/users/50cbf3ae3086497881595b704e8c8023` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:14.896614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cbf3ae3086497881595b704e8c8023)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:14.898888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:15.009343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cbf3ae3086497881595b704e8c8023'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:15.034163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cbf3ae3086497881595b704e8c8023'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:15.036597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cbf3ae3086497881595b704e8c8023'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:15.038389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cbf3ae3086497881595b704e8c8023'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:15.050257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cbf3ae3086497881595b704e8c8023'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:15.084563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 985/1941] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:14 2022] DELETE /identity/v3/users/50cbf3ae3086497881595b704e8c8023 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:15.600109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:15.602693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:15.634627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb09a9-e56e-4c1c-8152-a546ffda20cb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:15.879702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:15.890687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:15.891062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:15.891535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] PATH_INFO: `/v3/projects/8959500ed2af4377a16d78446ae95f20` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:15.894947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8959500ed2af4377a16d78446ae95f20)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:15.901530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:15.906881 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:16.073731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8959500ed2af4377a16d78446ae95f20', 'request_id': 'req-fb69b4dc-31c4-4549-a47d-d7d2bc919328'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.085415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8959500ed2af4377a16d78446ae95f20', 'request_id': 'req-fb69b4dc-31c4-4549-a47d-d7d2bc919328'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.105249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8959500ed2af4377a16d78446ae95f20', 'request_id': 'req-fb69b4dc-31c4-4549-a47d-d7d2bc919328'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.143473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] The token cache is being invalidate because project 8959500ed2af4377a16d78446ae95f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:16.144304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.146757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb69b4dc-31c4-4549-a47d-d7d2bc919328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.150437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 957/1942] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:15 2022] DELETE /identity/v3/projects/8959500ed2af4377a16d78446ae95f20 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:16.154894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:16.157210 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:16.184738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75db467-a8b0-4b58-a80d-98c15dd915cb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:16.328598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:16.329529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:16.330298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:16.330805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] PATH_INFO: `/v3/users/6399c929fc05441886fb49444d4120b7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:16.332342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6399c929fc05441886fb49444d4120b7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:16.334607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:16.365142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a58d-4298-4515-b883-2c4ecd661ea7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:16.365432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a58d-4298-4515-b883-2c4ecd661ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:16.365946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a58d-4298-4515-b883-2c4ecd661ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:16.415837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6399c929fc05441886fb49444d4120b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.417221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:16.440454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6399c929fc05441886fb49444d4120b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.441758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6399c929fc05441886fb49444d4120b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.442652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6399c929fc05441886fb49444d4120b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.443809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9055a58d-4298-4515-b883-2c4ecd661ea7 None None] MFA Rules not processed for user `2c77f0bef97f4a3681f6f3d435efd9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:16.446189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9055a58d-4298-4515-b883-2c4ecd661ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:16.461434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6399c929fc05441886fb49444d4120b7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:16.494112 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 986/1943] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:16 2022] DELETE /identity/v3/users/6399c929fc05441886fb49444d4120b7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:16.563014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 958/1944] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:17.509447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:17.511010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:17.736715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59fd3-5fde-49df-8683-39e62b570679 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:17.750065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:17.750738 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:17.751019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:17.751296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] PATH_INFO: `/v3/projects/466323a8b93a42cf9e226dd5206d9041` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:17.752526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=466323a8b93a42cf9e226dd5206d9041)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:17.754524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:17.922852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466323a8b93a42cf9e226dd5206d9041', 'request_id': 'req-a77cfdd9-5428-4835-a55c-65c87a4823c0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:17.947921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466323a8b93a42cf9e226dd5206d9041', 'request_id': 'req-a77cfdd9-5428-4835-a55c-65c87a4823c0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:17.973493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466323a8b93a42cf9e226dd5206d9041', 'request_id': 'req-a77cfdd9-5428-4835-a55c-65c87a4823c0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:18.004142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] The token cache is being invalidate because project 466323a8b93a42cf9e226dd5206d9041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:18.004496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:18.005101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a77cfdd9-5428-4835-a55c-65c87a4823c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:18.006952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 987/1945] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:17 2022] DELETE /identity/v3/projects/466323a8b93a42cf9e226dd5206d9041 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:18.011464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b1f7-baea-4914-b0bd-aaedb1e138fb None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:18.012525 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b1f7-baea-4914-b0bd-aaedb1e138fb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:18.012603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b1f7-baea-4914-b0bd-aaedb1e138fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:18.070868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bd08b1f7-baea-4914-b0bd-aaedb1e138fb None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:18.078655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bd08b1f7-baea-4914-b0bd-aaedb1e138fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:18.252314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 959/1946] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:18.253771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155fdf2-798b-42f9-acd3-113114488f33 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:18.254058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155fdf2-798b-42f9-acd3-113114488f33 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:18.254358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155fdf2-798b-42f9-acd3-113114488f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:18.311149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c155fdf2-798b-42f9-acd3-113114488f33 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:18.313432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c155fdf2-798b-42f9-acd3-113114488f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:18.346251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 988/1947] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:18.350608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08b1f7-baea-4914-b0bd-aaedb1e138fb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:18.374809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08b1f7-baea-4914-b0bd-aaedb1e138fb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:18.407634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:18.409558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:18.409845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:18.410147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:18.410829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:07:18.411139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:18.412771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:18.482673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155fdf2-798b-42f9-acd3-113114488f33 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:18.483025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 960/1948] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:07:18.497956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155fdf2-798b-42f9-acd3-113114488f33 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:18.524015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:18.524642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:18.524923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:18.525192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:18.525841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:18.539076 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:18.666317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 989/1949] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:07:18 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:18.667593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:18.683405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5769fcf-b844-4d26-97eb-22c641a9096f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:18.772737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:18.907938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:18.908726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:18.909103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:18.909493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:18.910360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:18.912353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:18.964593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 961/1950] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:07:18 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:18.968681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:19.003246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce3c2-826d-472a-9ed2-e026c6704abe admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:19.022402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:19.023578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:19.023842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:19.025119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:19.027006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:19.050818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:19.079499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 990/1951] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:19.083344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:19.100805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b4df-ff8a-4802-b3bc-6cc958485066 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:19.107828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6201512-79f8-4d29-aa14-fdedfaa9d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:19.108868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6201512-79f8-4d29-aa14-fdedfaa9d6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:19.109285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6201512-79f8-4d29-aa14-fdedfaa9d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:19.109791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6201512-79f8-4d29-aa14-fdedfaa9d6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:19.110614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6201512-79f8-4d29-aa14-fdedfaa9d6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:19.113084 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6201512-79f8-4d29-aa14-fdedfaa9d6b6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:19.127471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 962/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:19.131279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:19.149234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7363e-19ba-49fb-ad6c-b3388736a261 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:19.166524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:19.167301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:19.168142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:19.168919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] PATH_INFO: `/v3/projects/7a0b450c84e94fe0a7213abc230379b0/users/58a044379c2b4c9fb5cae08c2ecec4d1/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:19.204759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:19.210685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0b450c84e94fe0a7213abc230379b0, user_id=58a044379c2b4c9fb5cae08c2ecec4d1, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:19.213874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:19.255433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 991/1953] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:07:19 2022] PUT /identity/v3/projects/7a0b450c84e94fe0a7213abc230379b0/users/58a044379c2b4c9fb5cae08c2ecec4d1/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:07:19.269846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:19.270170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:19.270666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:19.348755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] MFA Rules not processed for user `58a044379c2b4c9fb5cae08c2ecec4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:19.350036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:19.566066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 963/1954] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:19.575332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:19.578045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:19.714320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd243b-239b-4590-bf00-6087dabcb7ea admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:19.719366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bad582-a524-4f48-a5e2-3a3b73b4e628 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:19.720389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad582-a524-4f48-a5e2-3a3b73b4e628 service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:19.720882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad582-a524-4f48-a5e2-3a3b73b4e628 service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:19.721617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad582-a524-4f48-a5e2-3a3b73b4e628 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:19.738104 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bad582-a524-4f48-a5e2-3a3b73b4e628 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:19.741258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bad582-a524-4f48-a5e2-3a3b73b4e628 service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:19.774268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 992/1955] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:26.191188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:26.192723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:26.294235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839fd6-d23b-4c36-9e03-8dc5445be066 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:26.300003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:26.300810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:26.301192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:26.301605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] PATH_INFO: `/v3/users/12e705bc45a54e7a948a4ac36d9e0e86` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:26.303446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e705bc45a54e7a948a4ac36d9e0e86)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:26.306233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:26.411636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:26.446896 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e705bc45a54e7a948a4ac36d9e0e86'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:26.455130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e705bc45a54e7a948a4ac36d9e0e86'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:26.463449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e705bc45a54e7a948a4ac36d9e0e86'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:26.464238 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e705bc45a54e7a948a4ac36d9e0e86'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:26.479208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e705bc45a54e7a948a4ac36d9e0e86'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:26.486474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 964/1956] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:26 2022] DELETE /identity/v3/users/12e705bc45a54e7a948a4ac36d9e0e86 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:26.490633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a2472-3a76-4ec1-8922-2f65a43c9c7f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:26.491077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a2472-3a76-4ec1-8922-2f65a43c9c7f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:26.491252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a2472-3a76-4ec1-8922-2f65a43c9c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:26.526128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cd1a2472-3a76-4ec1-8922-2f65a43c9c7f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:26.528055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cd1a2472-3a76-4ec1-8922-2f65a43c9c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:26.622545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 993/1957] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:26.635410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:26.638865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:26.750647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0527d1-9bcb-44da-8563-65c1fedcb960 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:26.759314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:26.760303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:26.760725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:26.761135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:26.778030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:26.781578 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:26.813742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 965/1958] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:27.427353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1cd3-81b4-4611-8140-fc4d7f063ef9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:27.427939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1cd3-81b4-4611-8140-fc4d7f063ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:27.428361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1cd3-81b4-4611-8140-fc4d7f063ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:27.451004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-830e1cd3-81b4-4611-8140-fc4d7f063ef9 None None] MFA Rules not processed for user `957cb82c764d478d8a82fb8bb44024f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:27.452539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-830e1cd3-81b4-4611-8140-fc4d7f063ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:27.546926 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 994/1959] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:27.603124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:27.605113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:27.631920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0449-1ce5-4266-8eef-e5ec15c48a69 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:27.648050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:27.648702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:27.648987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:27.649264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] PATH_INFO: `/v3/projects/283d2fe25196411093d05d704b45cf68` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:27.651040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283d2fe25196411093d05d704b45cf68)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:27.653552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:27.755253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283d2fe25196411093d05d704b45cf68', 'request_id': 'req-81388ebb-ce09-4665-a519-86bebba7f6f7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:27.770739 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283d2fe25196411093d05d704b45cf68', 'request_id': 'req-81388ebb-ce09-4665-a519-86bebba7f6f7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:27.787759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283d2fe25196411093d05d704b45cf68', 'request_id': 'req-81388ebb-ce09-4665-a519-86bebba7f6f7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:27.806810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] The token cache is being invalidate because project 283d2fe25196411093d05d704b45cf68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:27.807111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:27.807777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-81388ebb-ce09-4665-a519-86bebba7f6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:27.813602 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 966/1960] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:27 2022] DELETE /identity/v3/projects/283d2fe25196411093d05d704b45cf68 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:27.815259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143fbb-d37a-4d2b-9f3b-a5f3dc167910 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:27.815549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143fbb-d37a-4d2b-9f3b-a5f3dc167910 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:27.815830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143fbb-d37a-4d2b-9f3b-a5f3dc167910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:27.837869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-76143fbb-d37a-4d2b-9f3b-a5f3dc167910 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:27.839125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-76143fbb-d37a-4d2b-9f3b-a5f3dc167910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:27.880350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:27.945016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 995/1961] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:07:27.947492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abb18-b773-4653-9cae-bc4c9d2290fe None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:27.947780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abb18-b773-4653-9cae-bc4c9d2290fe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:27.948054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abb18-b773-4653-9cae-bc4c9d2290fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:27.981877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7a4abb18-b773-4653-9cae-bc4c9d2290fe None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:27.981877 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7a4abb18-b773-4653-9cae-bc4c9d2290fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:27.987114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 967/1962] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:07:27.991886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76143fbb-d37a-4d2b-9f3b-a5f3dc167910 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:28.003135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76143fbb-d37a-4d2b-9f3b-a5f3dc167910 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:28.014559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:28.015459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.015708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.016051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.017009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:07:28.022408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:28.024439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:28.047891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 996/1963] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:07:28.053616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4abb18-b773-4653-9cae-bc4c9d2290fe None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:28.064588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4abb18-b773-4653-9cae-bc4c9d2290fe None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:28.069542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:28.070406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.070554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.071212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.072325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:28.077149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:28.110152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 968/1964] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:07:28 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:28.113673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:28.125844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae9b8-ec10-4949-bbca-24cb490eae42 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:28.201373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:28.202065 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.202299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.202588 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.203383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:28.205415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:28.231793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 997/1965] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:07:28 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:07:28.236340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:28.249614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c6424-6219-4100-a828-d93bd241019e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:28.254994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:28.256534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.256825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.257102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.257755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:28.259427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:28.260917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:28.285118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 969/1966] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:28.286515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:28.297349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf1df8-648f-4300-8d3d-e0636bc67531 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:28.302060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d45f4-ee78-43b0-bea1-3591c3c2bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:28.302701 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d45f4-ee78-43b0-bea1-3591c3c2bc33 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.302988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d45f4-ee78-43b0-bea1-3591c3c2bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.303263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d45f4-ee78-43b0-bea1-3591c3c2bc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.303917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d45f4-ee78-43b0-bea1-3591c3c2bc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:28.305532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d45f4-ee78-43b0-bea1-3591c3c2bc33 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:28.327741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 998/1967] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:07:28.333488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:28.363036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f981c-0443-46f9-affc-eaab0c2d8c3f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:28.369863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:28.370693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.383653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.383653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] PATH_INFO: `/v3/projects/d1fe7fb48e5145529bbb987ee38fb081/users/9d7196ade9d84148992df323f5680142/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.415096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fe7fb48e5145529bbb987ee38fb081, user_id=9d7196ade9d84148992df323f5680142, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:28.420385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:28.455472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 970/1968] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:07:28 2022] PUT /identity/v3/projects/d1fe7fb48e5145529bbb987ee38fb081/users/9d7196ade9d84148992df323f5680142/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:28.521689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad54d-32dc-48a7-a028-d6e162287528 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.521976 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad54d-32dc-48a7-a028-d6e162287528 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.522462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad54d-32dc-48a7-a028-d6e162287528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.560167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bbaad54d-32dc-48a7-a028-d6e162287528 None None] MFA Rules not processed for user `9d7196ade9d84148992df323f5680142`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:28.561605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bbaad54d-32dc-48a7-a028-d6e162287528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:28.674516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 999/1969] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:28.689258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:28.691921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:28.766328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2696bfb-7198-4cb5-ab6c-1669451d1caa admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:28.771541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:28.772188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:28.772474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:28.772758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:28.784661 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:28.786327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:28.799664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 971/1970] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:33.551164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aed74b-c9d8-43c0-9305-daec704fa407 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:33.551657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aed74b-c9d8-43c0-9305-daec704fa407 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:33.551732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aed74b-c9d8-43c0-9305-daec704fa407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:33.573502 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f3aed74b-c9d8-43c0-9305-daec704fa407 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:33.575597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f3aed74b-c9d8-43c0-9305-daec704fa407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:33.632194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:33.672212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1000/1971] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:07:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:33.686652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:33.688856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:33.773665 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410d79c-c702-4023-8650-c1fa0e8c06b2 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:33.780698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2195f95-baa6-4889-a801-31f464a3196e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:33.781510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195f95-baa6-4889-a801-31f464a3196e service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:33.781893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195f95-baa6-4889-a801-31f464a3196e service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:33.782384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195f95-baa6-4889-a801-31f464a3196e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:33.801638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2195f95-baa6-4889-a801-31f464a3196e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:33.803264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2195f95-baa6-4889-a801-31f464a3196e service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:33.811966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 972/1972] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:07:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:07:40.234957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aed74b-c9d8-43c0-9305-daec704fa407 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:40.334818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aed74b-c9d8-43c0-9305-daec704fa407 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:40.343153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:40.343880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:40.344157 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:40.344465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] PATH_INFO: `/v3/users/9d7196ade9d84148992df323f5680142` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:40.345569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7196ade9d84148992df323f5680142)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:40.347849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:40.427513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7196ade9d84148992df323f5680142'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:40.470325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7196ade9d84148992df323f5680142'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:40.471197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7196ade9d84148992df323f5680142'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:40.471816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7196ade9d84148992df323f5680142'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:40.482233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7196ade9d84148992df323f5680142'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:40.496948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1001/1973] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:40 2022] DELETE /identity/v3/users/9d7196ade9d84148992df323f5680142 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:40.501315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:40.501938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:40.501938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:40.525434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:40.526742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:40.597579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 973/1974] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:40.607162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:40.608787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:40.732462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b28a4-e19d-41c8-b2a9-bceda3ad57e8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:40.736463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0073e-5416-46e4-a4b0-e8694022678d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:40.737156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0073e-5416-46e4-a4b0-e8694022678d service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:40.737500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0073e-5416-46e4-a4b0-e8694022678d service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:40.737972 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0073e-5416-46e4-a4b0-e8694022678d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:40.749205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0073e-5416-46e4-a4b0-e8694022678d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:40.750721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0073e-5416-46e4-a4b0-e8694022678d service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:40.764401 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1002/1975] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:41.330552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:41.335964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:41.355996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:41.362610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffa561-25e0-40bf-a4aa-30f4b7471e93 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:41.377624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:41.378503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:41.378895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:41.379272 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] PATH_INFO: `/v3/projects/d1fe7fb48e5145529bbb987ee38fb081` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:41.380541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fe7fb48e5145529bbb987ee38fb081)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:41.383617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:41.474118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fe7fb48e5145529bbb987ee38fb081', 'request_id': 'req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:41.484576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fe7fb48e5145529bbb987ee38fb081', 'request_id': 'req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:41.493737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fe7fb48e5145529bbb987ee38fb081', 'request_id': 'req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:41.524398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] The token cache is being invalidate because project d1fe7fb48e5145529bbb987ee38fb081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:41.525010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:41.525508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:41.542131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 974/1976] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:41 2022] DELETE /identity/v3/projects/d1fe7fb48e5145529bbb987ee38fb081 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:45.450242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:45.451374 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:45.451890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:45.459470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:45.475390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:45.476699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:45.556433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1003/1977] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:07:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:45.572031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:45.573478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:45.649226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e2fb-d0ef-4fed-b1d9-58f3def9a8c3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:45.654802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7431a57-0dec-46c3-af4a-51c13e6e1016 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:45.655432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7431a57-0dec-46c3-af4a-51c13e6e1016 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:45.655710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7431a57-0dec-46c3-af4a-51c13e6e1016 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:45.655989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7431a57-0dec-46c3-af4a-51c13e6e1016 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:45.664913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7431a57-0dec-46c3-af4a-51c13e6e1016 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:45.666544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7431a57-0dec-46c3-af4a-51c13e6e1016 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:45.676189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 975/1978] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:07:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:07:52.046429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:52.048879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:52.165768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46192fee-264d-46b8-a85a-ba113b794444 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:52.175475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:52.176740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:52.177582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:52.178126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] PATH_INFO: `/v3/users/959fd6123e39486ea317dd5a85e0e137` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:52.179685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959fd6123e39486ea317dd5a85e0e137)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:52.182444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:52.308840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959fd6123e39486ea317dd5a85e0e137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:52.325141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959fd6123e39486ea317dd5a85e0e137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:52.327049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959fd6123e39486ea317dd5a85e0e137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:52.327761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959fd6123e39486ea317dd5a85e0e137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:52.348493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959fd6123e39486ea317dd5a85e0e137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:52.369693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1004/1979] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:52 2022] DELETE /identity/v3/users/959fd6123e39486ea317dd5a85e0e137 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:52.376389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:52.376985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:52.377079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:52.400375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:52.401593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:52.510244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 976/1980] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:07:52.533511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:52.535294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:52.574556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:52.632797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9636-1031-47b9-9ec6-cb95152337a4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:52.637378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:52.638045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:52.638494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:52.638847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:52.649797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:52.651317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:52.664797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1005/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:53.170814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:53.173102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:53.191002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6afb4f-0a5f-4132-bdc0-a8aa0b70d428 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:53.199442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:53.202706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:53.203361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:53.204919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] PATH_INFO: `/v3/projects/22f929c6f11b4e97b736f54cad83673a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:53.206893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f929c6f11b4e97b736f54cad83673a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:53.209720 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:53.227285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:53.292568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f929c6f11b4e97b736f54cad83673a', 'request_id': 'req-7dfe5a56-eda7-4933-89d4-44ef777d295b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:53.302836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f929c6f11b4e97b736f54cad83673a', 'request_id': 'req-7dfe5a56-eda7-4933-89d4-44ef777d295b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:53.315425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f929c6f11b4e97b736f54cad83673a', 'request_id': 'req-7dfe5a56-eda7-4933-89d4-44ef777d295b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:53.335341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] The token cache is being invalidate because project 22f929c6f11b4e97b736f54cad83673a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:53.335692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:53.338872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7dfe5a56-eda7-4933-89d4-44ef777d295b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:53.341345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 977/1982] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:53 2022] DELETE /identity/v3/projects/22f929c6f11b4e97b736f54cad83673a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:55.526592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:55.528767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:55.546609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597340d-645e-440c-8ad3-e3a514bc61b8 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:55.617995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:55.618681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:55.618962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:55.619240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] PATH_INFO: `/v3/users/58a044379c2b4c9fb5cae08c2ecec4d1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:55.620428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a044379c2b4c9fb5cae08c2ecec4d1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:55.623238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:55.705474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a044379c2b4c9fb5cae08c2ecec4d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:55.719061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a044379c2b4c9fb5cae08c2ecec4d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:55.719850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a044379c2b4c9fb5cae08c2ecec4d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:55.720455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a044379c2b4c9fb5cae08c2ecec4d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:55.728596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a044379c2b4c9fb5cae08c2ecec4d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:55.742286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1006/1983] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:07:55 2022] DELETE /identity/v3/users/58a044379c2b4c9fb5cae08c2ecec4d1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:55.747183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:55.747183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:55.747657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:55.768933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:07:55.770178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:55.852207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 978/1984] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:07:55.864356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:55.865956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:55.957599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:07:55.962925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11228-e9f5-4a92-8e9b-63f415321d2f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:55.972799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:55.977966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:55.977966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:55.977966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:55.990821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:55.992356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:56.014285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1007/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:07:56.330212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:56.331810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:56.370596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b2c2-8263-424c-bc18-e17182bbc175 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:56.377388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:56.378178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:56.378530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:56.378895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] PATH_INFO: `/v3/projects/7a0b450c84e94fe0a7213abc230379b0` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:56.380075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0b450c84e94fe0a7213abc230379b0)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:56.382153 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:56.471266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0b450c84e94fe0a7213abc230379b0', 'request_id': 'req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:56.487108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0b450c84e94fe0a7213abc230379b0', 'request_id': 'req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:56.503377 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0b450c84e94fe0a7213abc230379b0', 'request_id': 'req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:56.516499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] The token cache is being invalidate because project 7a0b450c84e94fe0a7213abc230379b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:07:56.516795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:56.517579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8b4bfab1-8aeb-4cc8-afa2-92e7a014789e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:07:56.519622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 979/1986] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:07:56 2022] DELETE /identity/v3/projects/7a0b450c84e94fe0a7213abc230379b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:07:58.053655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:07:58.055081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:58.066726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818312d-f553-4714-a5fa-31f972b67017 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:07:58.115756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20c88a-bfb0-44df-b176-0d155651143c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:07:58.116357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20c88a-bfb0-44df-b176-0d155651143c service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:07:58.116634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20c88a-bfb0-44df-b176-0d155651143c service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:07:58.116907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20c88a-bfb0-44df-b176-0d155651143c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:07:58.118629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7f20c88a-bfb0-44df-b176-0d155651143c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:07:58.180020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20c88a-bfb0-44df-b176-0d155651143c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:07:58.181453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20c88a-bfb0-44df-b176-0d155651143c service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:07:58.191372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1008/1987] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:07:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:08:01.431212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c875ea-8a4a-431a-922c-395198fa339e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:01.431736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c875ea-8a4a-431a-922c-395198fa339e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:01.431905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c875ea-8a4a-431a-922c-395198fa339e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:01.433511 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 980/1988] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:08:01.445159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8739-23f8-40f2-a5d7-4e186ff8ad67 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:01.446047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8739-23f8-40f2-a5d7-4e186ff8ad67 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:01.446529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8739-23f8-40f2-a5d7-4e186ff8ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:01.490464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-156b8739-23f8-40f2-a5d7-4e186ff8ad67 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:08:01.493574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-156b8739-23f8-40f2-a5d7-4e186ff8ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:01.605789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1009/1989] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:08:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:08:01.623139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c875ea-8a4a-431a-922c-395198fa339e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:08:01.624882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-01c875ea-8a4a-431a-922c-395198fa339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:01.660887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:01.729209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c875ea-8a4a-431a-922c-395198fa339e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:08:01.734804 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f804ab9-51a0-48eb-913f-6014e335ebc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:08:01.735941 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804ab9-51a0-48eb-913f-6014e335ebc7 service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:01.736456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804ab9-51a0-48eb-913f-6014e335ebc7 service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:01.736910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804ab9-51a0-48eb-913f-6014e335ebc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:01.759517 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f804ab9-51a0-48eb-913f-6014e335ebc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:08:01.761157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f804ab9-51a0-48eb-913f-6014e335ebc7 service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:08:01.781040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 981/1990] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:08:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:08:01.865200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54837-7a0e-47cc-a6b1-864e2eb9bb37 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:01.865485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54837-7a0e-47cc-a6b1-864e2eb9bb37 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:01.865803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54837-7a0e-47cc-a6b1-864e2eb9bb37 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:01.867231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1010/1991] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:08:01.872916 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990296-3e95-4520-b764-e26003c35ad8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:01.873474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990296-3e95-4520-b764-e26003c35ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:01.873686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990296-3e95-4520-b764-e26003c35ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:01.894450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0d990296-3e95-4520-b764-e26003c35ad8 None None] MFA Rules not processed for user `3f748dc73ef7444d9382a0680e027c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:08:01.895702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0d990296-3e95-4520-b764-e26003c35ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:01.902980 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 982/1992] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:08:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:08:01.917687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa54837-7a0e-47cc-a6b1-864e2eb9bb37 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:08:01.919608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3fa54837-7a0e-47cc-a6b1-864e2eb9bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:01.933114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa54837-7a0e-47cc-a6b1-864e2eb9bb37 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:08:01.938014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeabd4-033a-4f94-9adf-3c6eb0516bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:08:01.938645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeabd4-033a-4f94-9adf-3c6eb0516bca service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:01.938959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeabd4-033a-4f94-9adf-3c6eb0516bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:01.939237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeabd4-033a-4f94-9adf-3c6eb0516bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:01.946390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeabd4-033a-4f94-9adf-3c6eb0516bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:08:01.947823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeabd4-033a-4f94-9adf-3c6eb0516bca service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:08:01.956299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1011/1993] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:08:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:08:02.055325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff227b1-ac0f-4ea7-b0e1-30d1f47e1f14 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:02.055672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff227b1-ac0f-4ea7-b0e1-30d1f47e1f14 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:02.055957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff227b1-ac0f-4ea7-b0e1-30d1f47e1f14 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:02.057317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 983/1994] 10.222.0.18 () {54 vars in 921 bytes} [Sun Oct 23 20:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:08:02.063889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1fda-3a3d-496d-b16c-3351684a3c48 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:02.064180 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1fda-3a3d-496d-b16c-3351684a3c48 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:02.064453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1fda-3a3d-496d-b16c-3351684a3c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:02.084198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e3fe1fda-3a3d-496d-b16c-3351684a3c48 None None] MFA Rules not processed for user `155cc268d5ef4e47bb7a16093a360ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:08:02.085450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e3fe1fda-3a3d-496d-b16c-3351684a3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:02.095008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1012/1995] 10.222.0.18 () {58 vars in 1018 bytes} [Sun Oct 23 20:08:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:08:02.105871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff227b1-ac0f-4ea7-b0e1-30d1f47e1f14 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:08:02.108521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7ff227b1-ac0f-4ea7-b0e1-30d1f47e1f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:02.122957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff227b1-ac0f-4ea7-b0e1-30d1f47e1f14 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:08:02.126585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:08:02.127196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:02.127479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:02.127753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:02.138356 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:08:02.139769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:08:02.151227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 984/1996] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:08:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:08:04.742893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7be68-722d-4e4f-91a7-e436e6e21168 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:04.743356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7be68-722d-4e4f-91a7-e436e6e21168 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:04.743443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7be68-722d-4e4f-91a7-e436e6e21168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:04.763664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a3e7be68-722d-4e4f-91a7-e436e6e21168 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:08:04.764794 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a3e7be68-722d-4e4f-91a7-e436e6e21168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:04.773559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:04.819628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1013/1997] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:08:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:08:04.832391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:08:04.833771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:04.899924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7c57-3207-46a4-97c9-5ac1819ec07d service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:08:04.905089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:08:04.905683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:04.905961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:04.906263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:04.914072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:08:04.915659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:08:04.923559 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 985/1998] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:08:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:08:14.812797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=19 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:14.920468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=56 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:27.387715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575125-26b1-4047-82fe-6db2678e4c3e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:27.388669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575125-26b1-4047-82fe-6db2678e4c3e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:27.389178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06575125-26b1-4047-82fe-6db2678e4c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:27.409526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-06575125-26b1-4047-82fe-6db2678e4c3e None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:08:27.411146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-06575125-26b1-4047-82fe-6db2678e4c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:27.435468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1014/1999] 10.222.0.18 () {58 vars in 967 bytes} [Sun Oct 23 20:08:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:08:27.448631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:08:27.459100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86c16f-26ee-4cb2-acea-bf3514116c81 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:08:27.470793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:08:27.471821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:27.472325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:27.472870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:27.484744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:08:27.487011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:08:27.502189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 986/2000] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:08:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:08:28.695960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290fee1-d40f-4b8d-9790-802757fc6121 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:28.696608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290fee1-d40f-4b8d-9790-802757fc6121 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:28.696608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290fee1-d40f-4b8d-9790-802757fc6121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:28.717822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7290fee1-d40f-4b8d-9790-802757fc6121 None None] MFA Rules not processed for user `01156595a74941a9933834c824f87952`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:08:28.719088 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7290fee1-d40f-4b8d-9790-802757fc6121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:28.784162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1015/2001] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:08:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:08:37.498319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=6 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:38.406045 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:08:38.407802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:38.500098 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d815f-4fa2-49f5-90f6-fde14dcce137 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:08:38.505764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743afd6-7668-4e13-8b42-b949c95dfb13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:08:38.506405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743afd6-7668-4e13-8b42-b949c95dfb13 service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:38.506686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743afd6-7668-4e13-8b42-b949c95dfb13 service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:38.506961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743afd6-7668-4e13-8b42-b949c95dfb13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:38.508726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5743afd6-7668-4e13-8b42-b949c95dfb13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:38.521775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743afd6-7668-4e13-8b42-b949c95dfb13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:08:38.523401 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743afd6-7668-4e13-8b42-b949c95dfb13 service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:08:38.534480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 987/2002] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:08:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:08:38.776810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=28 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:39.661344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a75c42-710a-4235-b7f7-b0c96bec6065 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:08:39.661884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a75c42-710a-4235-b7f7-b0c96bec6065 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:08:39.662446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a75c42-710a-4235-b7f7-b0c96bec6065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:08:39.682943 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-10a75c42-710a-4235-b7f7-b0c96bec6065 None None] MFA Rules not processed for user `2c77f0bef97f4a3681f6f3d435efd9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:08:39.684371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-10a75c42-710a-4235-b7f7-b0c96bec6065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:08:39.760257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1016/2003] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:08:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:08:48.529979 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=32 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:08:49.752278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=25 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:19.570541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f35cd-7da5-47f5-a626-af6f178e7025 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:09:19.571050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f35cd-7da5-47f5-a626-af6f178e7025 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:09:19.571152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f35cd-7da5-47f5-a626-af6f178e7025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:09:19.590628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0b4f35cd-7da5-47f5-a626-af6f178e7025 None None] MFA Rules not processed for user `5c7a939da3c34d418d768cb7bdf9920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:09:19.591838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0b4f35cd-7da5-47f5-a626-af6f178e7025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:09:19.647511 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 988/2004] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:09:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:09:29.640712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=25 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:40.862710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633cd8-255d-42eb-9fc7-c4765a8fa646 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:09:40.863239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633cd8-255d-42eb-9fc7-c4765a8fa646 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:09:40.863352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633cd8-255d-42eb-9fc7-c4765a8fa646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:09:40.883868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-14633cd8-255d-42eb-9fc7-c4765a8fa646 None None] MFA Rules not processed for user `2e4843b52aa8440a8ec485d103932ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:09:40.885066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-14633cd8-255d-42eb-9fc7-c4765a8fa646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:09:40.939312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1017/2005] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:09:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:09:50.931503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=25 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:09:53.239560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dd7e8-d2a2-4afa-b5f2-0c21dc6f0f87 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:09:53.239976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dd7e8-d2a2-4afa-b5f2-0c21dc6f0f87 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:09:53.240146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303dd7e8-d2a2-4afa-b5f2-0c21dc6f0f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:09:53.263504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-303dd7e8-d2a2-4afa-b5f2-0c21dc6f0f87 None None] MFA Rules not processed for user `2c77f0bef97f4a3681f6f3d435efd9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:09:53.264774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-303dd7e8-d2a2-4afa-b5f2-0c21dc6f0f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:09:53.272320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 989/2006] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:09:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:09:54.763880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ece1-9b7d-47e6-b20b-356286f069ee None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:09:54.764361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ece1-9b7d-47e6-b20b-356286f069ee None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:09:54.764465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ece1-9b7d-47e6-b20b-356286f069ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:09:54.783793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8939ece1-9b7d-47e6-b20b-356286f069ee None None] MFA Rules not processed for user `01156595a74941a9933834c824f87952`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:09:54.784992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8939ece1-9b7d-47e6-b20b-356286f069ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:09:54.791849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1018/2007] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:09:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:10:03.257836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:04.778403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:09.623426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:09.623870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:09.624074 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:09.645500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:10:09.646897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:09.654694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 990/2008] 10.222.0.18 () {58 vars in 967 bytes} [Sun Oct 23 20:10:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:10:09.749199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939ece1-9b7d-47e6-b20b-356286f069ee None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:09.761190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939ece1-9b7d-47e6-b20b-356286f069ee None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:09.766273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:09.766894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:09.767171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:09.767443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:09.775534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:09.777107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:09.785585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1019/2009] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:10:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:10:16.981740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:16.983476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:17.074809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf36e9-7edf-4145-b307-cee0ed52cbcc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:17.079417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:17.080044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:17.080329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:17.080609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] PATH_INFO: `/v3/users/957cb82c764d478d8a82fb8bb44024f3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:17.081745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=957cb82c764d478d8a82fb8bb44024f3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:17.083705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:17.130591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957cb82c764d478d8a82fb8bb44024f3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.137542 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957cb82c764d478d8a82fb8bb44024f3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.145315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957cb82c764d478d8a82fb8bb44024f3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.145970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957cb82c764d478d8a82fb8bb44024f3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.158265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957cb82c764d478d8a82fb8bb44024f3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.164037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 991/2010] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:10:16 2022] DELETE /identity/v3/users/957cb82c764d478d8a82fb8bb44024f3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:10:17.338600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:17.358665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d3e42-3adb-484a-9dc5-b725e0c6a674 service swift] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:17.417517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:17.418059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:17.418361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:17.418633 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] PATH_INFO: `/v3/projects/04c87c6f249a40bfa38f3f3b53620c90` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:17.419745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c87c6f249a40bfa38f3f3b53620c90)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:17.421855 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:17.467603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c87c6f249a40bfa38f3f3b53620c90', 'request_id': 'req-d4eaffb3-f80b-4713-8488-2206b097bae9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.474447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c87c6f249a40bfa38f3f3b53620c90', 'request_id': 'req-d4eaffb3-f80b-4713-8488-2206b097bae9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.481778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c87c6f249a40bfa38f3f3b53620c90', 'request_id': 'req-d4eaffb3-f80b-4713-8488-2206b097bae9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.491913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] The token cache is being invalidate because project 04c87c6f249a40bfa38f3f3b53620c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:10:17.492200 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.492811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.494403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1020/2011] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:10:17 2022] DELETE /identity/v3/projects/04c87c6f249a40bfa38f3f3b53620c90 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:10:17.498486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:17.500113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:17.513278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4c87f-527c-4c49-aa86-d765908f0714 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:17.570554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:17.571187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:17.571466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:17.571740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] PATH_INFO: `/v3/users/0edd15ac8945456baa95f23db4714490` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:17.572986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edd15ac8945456baa95f23db4714490)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:17.575179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:17.589396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:17.629059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edd15ac8945456baa95f23db4714490'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.636889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edd15ac8945456baa95f23db4714490'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.644582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edd15ac8945456baa95f23db4714490'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.645202 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edd15ac8945456baa95f23db4714490'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.657857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb032173-817d-4b7b-99d3-32019d186843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edd15ac8945456baa95f23db4714490'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:17.663828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 992/2012] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:10:17 2022] DELETE /identity/v3/users/0edd15ac8945456baa95f23db4714490 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:10:17.849475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:17.850947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:17.865893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaffb3-f80b-4713-8488-2206b097bae9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:17.946130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:17.946760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:17.947037 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:17.947311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] PATH_INFO: `/v3/projects/3f78ecd7760f4cad902d60ec7f3ddcc3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:17.948435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f78ecd7760f4cad902d60ec7f3ddcc3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:17.950403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:17.971965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:17.998665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f78ecd7760f4cad902d60ec7f3ddcc3', 'request_id': 'req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:18.004628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f78ecd7760f4cad902d60ec7f3ddcc3', 'request_id': 'req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:18.012008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f78ecd7760f4cad902d60ec7f3ddcc3', 'request_id': 'req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:18.023184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] The token cache is being invalidate because project 3f78ecd7760f4cad902d60ec7f3ddcc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:10:18.023471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:18.024087 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:10:18.025542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1021/2013] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:10:17 2022] DELETE /identity/v3/projects/3f78ecd7760f4cad902d60ec7f3ddcc3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:10:27.660216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:28.020229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:36.294011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:36.294519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:36.294613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:36.313760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:10:36.314977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:36.369832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 993/2014] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:10:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:10:36.381877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:36.383304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:36.456108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397bab3-2fb0-4e09-a7e6-68f73a7bd934 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:36.461246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:36.461854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:36.462185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:36.462465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:36.471697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:36.473264 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:36.490964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1022/2015] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:10:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:10:44.161778 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:44.165049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:44.275499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de52e-2838-45d2-8bcb-f5b708570f42 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:44.281456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:44.282287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:44.282672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:44.283053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:44.285179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:44.369545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:44.371317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:44.382566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 994/2016] 10.222.0.18 () {60 vars in 1396 bytes} [Sun Oct 23 20:10:44 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:10:46.478050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=32 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:49.659519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:49.660952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:49.718352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051340-5d49-4e60-b49d-cd266e829977 service swift] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:49.721942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:49.722567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:49.722852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:49.723120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:49.724847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:49.782600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:49.784059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:49.793144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1023/2017] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:10:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:10:51.088930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:51.097504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2867435-2690-42d3-844a-96eb991a5945 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:51.101139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:51.101736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:51.102025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:51.102333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:51.104047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:51.157517 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:51.175780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:51.177177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:51.188819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 995/2018] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:10:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:10:51.686721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:51.695742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87df66-a7ef-4855-9ef6-ddfd7d9470c1 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:51.699466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:51.700069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:51.700346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:51.700644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:51.703185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:51.763789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:51.765262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:51.777084 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1024/2019] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:10:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:10:54.238842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:54.263178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be9bc1-b4ba-429f-9509-09eee3793b34 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:54.271064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:54.272218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:54.272830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:54.273449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:54.277123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:54.310213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:54.318021 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:54.353538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 996/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:10:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:10:54.503719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:10:54.505192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:54.594452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:10:54.625134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6e16-5063-46d1-9a2f-452ee925f91a service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:10:54.632122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451e393-97d8-48b6-bd9b-19d6495084a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:10:54.632733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451e393-97d8-48b6-bd9b-19d6495084a6 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:10:54.634045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451e393-97d8-48b6-bd9b-19d6495084a6 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:10:54.634369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451e393-97d8-48b6-bd9b-19d6495084a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:10:54.636240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b451e393-97d8-48b6-bd9b-19d6495084a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:10:54.651271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451e393-97d8-48b6-bd9b-19d6495084a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:10:54.653493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451e393-97d8-48b6-bd9b-19d6495084a6 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:10:54.665622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1025/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:10:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:03.308993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:03.310663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:03.325638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc012d-fa1d-4b9f-a095-7e35b9b5e587 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:03.330096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:03.330883 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:03.331287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:03.332090 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:03.333870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:03.344999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:03.346495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:03.357718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 997/2022] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:04.661505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:04.688103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665284-2a32-4637-adb6-5a0c0448ac79 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:04.688685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665284-2a32-4637-adb6-5a0c0448ac79 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:04.689235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665284-2a32-4637-adb6-5a0c0448ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:04.731323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-86665284-2a32-4637-adb6-5a0c0448ac79 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:04.733134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-86665284-2a32-4637-adb6-5a0c0448ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:04.750049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1026/2023] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:11:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:04.770401 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:04.791763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58276665-78ca-4780-8047-d78fbbe6d50c service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:04.818942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:04.819616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:04.819906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:04.820225 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:04.853798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:04.857940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:04.885055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 998/2024] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:11:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:11:10.891554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665284-2a32-4637-adb6-5a0c0448ac79 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:10.896973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:10.898879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:10.913984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665284-2a32-4637-adb6-5a0c0448ac79 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:10.943178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:10.944099 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:10.944525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:10.944940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:10.948045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:10.974929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:10.976815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:11.004635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1027/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:11.055758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7689f-7a0f-425e-a3fb-4010efffbdfa service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:11.073376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:11.075261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:11.076121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:11.076967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] PATH_INFO: `/v3/users/01156595a74941a9933834c824f87952` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:11.081834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01156595a74941a9933834c824f87952)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:11.087623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:11.177275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01156595a74941a9933834c824f87952'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.189009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01156595a74941a9933834c824f87952'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.201307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01156595a74941a9933834c824f87952'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.203529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01156595a74941a9933834c824f87952'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.226669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fbf51597-3971-412b-a357-02047b548803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01156595a74941a9933834c824f87952'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.238334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 999/2026] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:10 2022] DELETE /identity/v3/users/01156595a74941a9933834c824f87952 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:11.464470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:11.476247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed84-0068-4e62-8850-d0fe0b933569 service placement] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:11.555207 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:11.556403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:11.556923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:11.557565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] PATH_INFO: `/v3/projects/c89b9b8bd5dc49798ac834bb86c2fde3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:11.559111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89b9b8bd5dc49798ac834bb86c2fde3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:11.561365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:11.628255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89b9b8bd5dc49798ac834bb86c2fde3', 'request_id': 'req-b55cabb6-c817-4a4c-a734-cf027b6834ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.634896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89b9b8bd5dc49798ac834bb86c2fde3', 'request_id': 'req-b55cabb6-c817-4a4c-a734-cf027b6834ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.647555 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89b9b8bd5dc49798ac834bb86c2fde3', 'request_id': 'req-b55cabb6-c817-4a4c-a734-cf027b6834ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.660929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] The token cache is being invalidate because project c89b9b8bd5dc49798ac834bb86c2fde3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:11.661217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.662014 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b55cabb6-c817-4a4c-a734-cf027b6834ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:11.663551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1028/2027] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:11 2022] DELETE /identity/v3/projects/c89b9b8bd5dc49798ac834bb86c2fde3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:11.668608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09f9d-dbb8-45ae-a874-faa14fd76f2f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:11.668907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09f9d-dbb8-45ae-a874-faa14fd76f2f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:11.669188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09f9d-dbb8-45ae-a874-faa14fd76f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:11.690266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-01a09f9d-dbb8-45ae-a874-faa14fd76f2f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:11.691498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-01a09f9d-dbb8-45ae-a874-faa14fd76f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:11.713302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:11.766583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1000/2028] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:11.773981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449964dc-fd6a-4afb-9316-42c261659cea None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:11.774316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449964dc-fd6a-4afb-9316-42c261659cea None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:11.774591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449964dc-fd6a-4afb-9316-42c261659cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:11.799232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-449964dc-fd6a-4afb-9316-42c261659cea None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:11.800505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-449964dc-fd6a-4afb-9316-42c261659cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:11.808509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1029/2029] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:11.813077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a09f9d-dbb8-45ae-a874-faa14fd76f2f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:11.822742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a09f9d-dbb8-45ae-a874-faa14fd76f2f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:11.827262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:11.827991 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:11.828273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:11.828544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:11.829212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:11.829512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:11.831121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:11.845288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1001/2030] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:11.848762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449964dc-fd6a-4afb-9316-42c261659cea None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:11.858435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449964dc-fd6a-4afb-9316-42c261659cea None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:11.866529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:11.867419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:11.867796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:11.868335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:11.869072 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:11.871131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:11.903962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1030/2031] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:11 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:11.909071 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:11.919165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389ec6-4a1b-4471-8314-ce44c201dfc0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:11.992573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:11.993216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:11.993501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:11.993775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:11.994461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:11.996367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:12.017047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1002/2032] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:11 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:12.021322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:12.032591 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a00a1-e955-4756-9108-a6ee518b5338 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:12.040898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:12.041735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:12.042016 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:12.042339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:12.042994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:12.044786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:12.057074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1031/2033] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:12.061519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:12.072584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7929-0f76-4a8e-abff-c5838361d2fd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:12.078970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cd999-7f51-4591-9667-b36dc608d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:12.079796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd999-7f51-4591-9667-b36dc608d195 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:12.080414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd999-7f51-4591-9667-b36dc608d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:12.081015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cd999-7f51-4591-9667-b36dc608d195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:12.081833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd999-7f51-4591-9667-b36dc608d195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:12.084100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cd999-7f51-4591-9667-b36dc608d195 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:12.097486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1003/2034] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:12.101813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:12.112162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a6fb7-1270-46d7-a31e-18e49fd417c9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:12.117103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:12.117693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:12.117975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:12.118323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] PATH_INFO: `/v3/projects/90690c1bd6d749259d5183c7cb2edfdb/users/d5af7301e95a44058a2a8cc589e006a5/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:12.150845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=90690c1bd6d749259d5183c7cb2edfdb, user_id=d5af7301e95a44058a2a8cc589e006a5, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:12.154238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:12.173978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1032/2035] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:12 2022] PUT /identity/v3/projects/90690c1bd6d749259d5183c7cb2edfdb/users/d5af7301e95a44058a2a8cc589e006a5/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:12.185047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac234cc-a293-406b-bac6-e76b4b135ef9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:12.185338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac234cc-a293-406b-bac6-e76b4b135ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:12.185610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac234cc-a293-406b-bac6-e76b4b135ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:12.263210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-dac234cc-a293-406b-bac6-e76b4b135ef9 None None] MFA Rules not processed for user `d5af7301e95a44058a2a8cc589e006a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:12.264215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dac234cc-a293-406b-bac6-e76b4b135ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:12.408357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1004/2036] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:12.457215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:12.459586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:12.473267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:12.576452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa82ae-580e-403c-9cfc-a794451c49ab admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:12.582985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c928f-c22f-478e-acbc-0a96dd632dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:12.583582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c928f-c22f-478e-acbc-0a96dd632dd3 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:12.583858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c928f-c22f-478e-acbc-0a96dd632dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:12.584224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c928f-c22f-478e-acbc-0a96dd632dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:12.594786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c928f-c22f-478e-acbc-0a96dd632dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:12.596393 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c928f-c22f-478e-acbc-0a96dd632dd3 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:12.618383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1033/2037] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:15.386729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac234cc-a293-406b-bac6-e76b4b135ef9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:15.406248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:15.448357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac234cc-a293-406b-bac6-e76b4b135ef9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:15.452840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:15.453452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:15.453731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:15.454003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] PATH_INFO: `/v3/users/d5af7301e95a44058a2a8cc589e006a5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:15.456159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5af7301e95a44058a2a8cc589e006a5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:15.458144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:15.504789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5af7301e95a44058a2a8cc589e006a5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:15.511623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5af7301e95a44058a2a8cc589e006a5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:15.519726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5af7301e95a44058a2a8cc589e006a5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:15.520439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5af7301e95a44058a2a8cc589e006a5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:15.532438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5af7301e95a44058a2a8cc589e006a5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:15.542488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1005/2038] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:15 2022] DELETE /identity/v3/users/d5af7301e95a44058a2a8cc589e006a5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:15.547100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:15.547513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:15.547513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:15.569617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:15.569617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:15.639830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1034/2039] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:15.651312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:15.653080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:15.715171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c341caa-0996-45e2-bcd7-1fc7d203744d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:15.718854 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30c509-a12d-499c-8b8e-2ccf788f5f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:15.719465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c509-a12d-499c-8b8e-2ccf788f5f48 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:15.719746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c509-a12d-499c-8b8e-2ccf788f5f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:15.720017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30c509-a12d-499c-8b8e-2ccf788f5f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:15.729519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30c509-a12d-499c-8b8e-2ccf788f5f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:15.731015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30c509-a12d-499c-8b8e-2ccf788f5f48 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:15.743263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1006/2040] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:16.256550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:16.258055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:16.279379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965002b8-5f6c-48cc-9a3d-699dda221638 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:16.288493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:16.288788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.289227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.289773 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] PATH_INFO: `/v3/projects/90690c1bd6d749259d5183c7cb2edfdb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.291119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90690c1bd6d749259d5183c7cb2edfdb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:16.293191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:16.372512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90690c1bd6d749259d5183c7cb2edfdb', 'request_id': 'req-1a6d5321-2686-41d9-80bd-499d8e0f46c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:16.381723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90690c1bd6d749259d5183c7cb2edfdb', 'request_id': 'req-1a6d5321-2686-41d9-80bd-499d8e0f46c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:16.395887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90690c1bd6d749259d5183c7cb2edfdb', 'request_id': 'req-1a6d5321-2686-41d9-80bd-499d8e0f46c4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:16.412558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] The token cache is being invalidate because project 90690c1bd6d749259d5183c7cb2edfdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:16.413233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:16.414337 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1a6d5321-2686-41d9-80bd-499d8e0f46c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:16.416666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1035/2041] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:16 2022] DELETE /identity/v3/projects/90690c1bd6d749259d5183c7cb2edfdb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:16.431929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb448103-7422-48da-82c3-a6a1d8917e1b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.433340 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb448103-7422-48da-82c3-a6a1d8917e1b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.433807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb448103-7422-48da-82c3-a6a1d8917e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.462357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-eb448103-7422-48da-82c3-a6a1d8917e1b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:16.463303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-eb448103-7422-48da-82c3-a6a1d8917e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:16.516708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:16.558544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1007/2042] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:16.562860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc582aef-b4b3-42c9-bf3f-df0907b72b28 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.563355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc582aef-b4b3-42c9-bf3f-df0907b72b28 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.563463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc582aef-b4b3-42c9-bf3f-df0907b72b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.588066 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cc582aef-b4b3-42c9-bf3f-df0907b72b28 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:16.589346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cc582aef-b4b3-42c9-bf3f-df0907b72b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:16.598760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1036/2043] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:16.603179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb448103-7422-48da-82c3-a6a1d8917e1b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:16.614797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb448103-7422-48da-82c3-a6a1d8917e1b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:16.619623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:16.620236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.620518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.620792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.621449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:16.621754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:16.623445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:16.635538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1008/2044] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:16.640004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc582aef-b4b3-42c9-bf3f-df0907b72b28 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:16.650527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc582aef-b4b3-42c9-bf3f-df0907b72b28 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:16.655937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:16.656654 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.656938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.657238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.657930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:16.660799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:16.666952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:16.692298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1037/2045] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:16 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:16.696740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:16.709209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24464816-cb58-4de1-af03-72b341e7660b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:16.780550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:16.781229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.781772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.781772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.788683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:16.788683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:16.815181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1009/2046] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:16 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:16.819254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:16.830652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e822-20ec-4f94-936d-a85ecf2df5e3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:16.848899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:16.849765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.850266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.850824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.852465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:16.854954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:16.868978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1038/2047] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:16.870417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:16.884212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7eac-ee4c-4f3a-908e-59f5a9c324e4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:16.889269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078eea6c-2d3c-46f0-9df3-300ad5649385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:16.889974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eea6c-2d3c-46f0-9df3-300ad5649385 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.890362 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eea6c-2d3c-46f0-9df3-300ad5649385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.890708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078eea6c-2d3c-46f0-9df3-300ad5649385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.891427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078eea6c-2d3c-46f0-9df3-300ad5649385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:16.894155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078eea6c-2d3c-46f0-9df3-300ad5649385 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:16.909479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1010/2048] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:16.913833 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:16.924496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f996-d60e-4d05-adc7-459c280c5a17 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:16.929208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:16.929861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.930184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.930463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] PATH_INFO: `/v3/projects/3b58b280af91483a8fc57787bdcfe757/users/3835ff5e44f04bb382c7ab2ecd0e2cce/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:16.946850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b58b280af91483a8fc57787bdcfe757, user_id=3835ff5e44f04bb382c7ab2ecd0e2cce, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:16.949584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:16.963696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1039/2049] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:16 2022] PUT /identity/v3/projects/3b58b280af91483a8fc57787bdcfe757/users/3835ff5e44f04bb382c7ab2ecd0e2cce/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:16.974527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2ae45-4b49-4a64-95e9-5eef74907956 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:16.974886 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2ae45-4b49-4a64-95e9-5eef74907956 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:16.975241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2ae45-4b49-4a64-95e9-5eef74907956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:17.003444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6ec2ae45-4b49-4a64-95e9-5eef74907956 None None] MFA Rules not processed for user `3835ff5e44f04bb382c7ab2ecd0e2cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:17.004680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6ec2ae45-4b49-4a64-95e9-5eef74907956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:17.071943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1011/2050] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:17.083892 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:17.085646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:17.159817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79a876-6aae-4496-b47a-d98608e8de4e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:17.165252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fecdfa-010e-4fb2-8073-21d7a7f7090e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:17.165841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecdfa-010e-4fb2-8073-21d7a7f7090e service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:17.166145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecdfa-010e-4fb2-8073-21d7a7f7090e service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:17.166416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecdfa-010e-4fb2-8073-21d7a7f7090e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:17.175029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fecdfa-010e-4fb2-8073-21d7a7f7090e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:17.176606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fecdfa-010e-4fb2-8073-21d7a7f7090e service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:17.185612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1040/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:17.392947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2ae45-4b49-4a64-95e9-5eef74907956 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:17.432314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:17.455252 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2ae45-4b49-4a64-95e9-5eef74907956 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:17.459942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:17.460581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:17.460864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:17.461139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] PATH_INFO: `/v3/users/3835ff5e44f04bb382c7ab2ecd0e2cce` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:17.462304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3835ff5e44f04bb382c7ab2ecd0e2cce)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:17.464207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:17.515451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3835ff5e44f04bb382c7ab2ecd0e2cce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:17.521722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3835ff5e44f04bb382c7ab2ecd0e2cce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:17.531613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3835ff5e44f04bb382c7ab2ecd0e2cce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:17.531613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3835ff5e44f04bb382c7ab2ecd0e2cce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:17.542890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3835ff5e44f04bb382c7ab2ecd0e2cce'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:17.549819 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1012/2052] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:17 2022] DELETE /identity/v3/users/3835ff5e44f04bb382c7ab2ecd0e2cce => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:17.554418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:17.554806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:17.555079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:17.575163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:17.576367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:17.640285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1041/2053] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:17.651953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:17.653456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:17.711719 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907ed60-7409-460c-9f3a-610c0c9befd7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:17.715776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5d79-2e0b-4652-a1fe-7931417bee90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:17.716411 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5d79-2e0b-4652-a1fe-7931417bee90 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:17.716689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5d79-2e0b-4652-a1fe-7931417bee90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:17.716978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5d79-2e0b-4652-a1fe-7931417bee90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:17.726655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5d79-2e0b-4652-a1fe-7931417bee90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:17.728068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5d79-2e0b-4652-a1fe-7931417bee90 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:17.737383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1013/2054] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:18.013405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.015098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:18.040307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac865ec5-8ad6-43e1-926b-54b64030af5b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.045399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.055823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.055823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.055823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] PATH_INFO: `/v3/projects/3b58b280af91483a8fc57787bdcfe757` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.055823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b58b280af91483a8fc57787bdcfe757)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.055823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.193498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:18.207638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b58b280af91483a8fc57787bdcfe757', 'request_id': 'req-10bc7538-7822-4811-94d6-572787cc82d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:18.213699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b58b280af91483a8fc57787bdcfe757', 'request_id': 'req-10bc7538-7822-4811-94d6-572787cc82d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:18.235761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b58b280af91483a8fc57787bdcfe757', 'request_id': 'req-10bc7538-7822-4811-94d6-572787cc82d1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:18.257356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] The token cache is being invalidate because project 3b58b280af91483a8fc57787bdcfe757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:18.257651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:18.258363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-10bc7538-7822-4811-94d6-572787cc82d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:18.260118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1042/2055] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:18 2022] DELETE /identity/v3/projects/3b58b280af91483a8fc57787bdcfe757 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:18.265156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235170-4638-4c63-82d9-615e1505ad76 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.265471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235170-4638-4c63-82d9-615e1505ad76 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.265818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235170-4638-4c63-82d9-615e1505ad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.289418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-eb235170-4638-4c63-82d9-615e1505ad76 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:18.290667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-eb235170-4638-4c63-82d9-615e1505ad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:18.350423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:18.362761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1014/2056] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:18.372080 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d746345-a9fa-45a7-8b7b-2a8e6caa1d88 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.372640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d746345-a9fa-45a7-8b7b-2a8e6caa1d88 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.373825 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d746345-a9fa-45a7-8b7b-2a8e6caa1d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.398411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3d746345-a9fa-45a7-8b7b-2a8e6caa1d88 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:18.399700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3d746345-a9fa-45a7-8b7b-2a8e6caa1d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:18.410585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1043/2057] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:18.413655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235170-4638-4c63-82d9-615e1505ad76 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.425099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235170-4638-4c63-82d9-615e1505ad76 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.430748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.431474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.431858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.432338 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.433392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:18.433702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.436970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.453899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1015/2058] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:18.458452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d746345-a9fa-45a7-8b7b-2a8e6caa1d88 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.468153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d746345-a9fa-45a7-8b7b-2a8e6caa1d88 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.475113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.475113 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.475383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.475651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.476890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.479501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.516392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1044/2059] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:18 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:18.518677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.529613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdd41f-4c18-4a9e-9f44-605d13d9e76e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.597552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.598234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.598514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.598784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.599421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.601366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.626000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1016/2060] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:18 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:18.630308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.640647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b72ee5-1b6e-4511-919e-d44d839cec76 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.645378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.646069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.646385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.646658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.647353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.649585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.662120 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1045/2061] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:18.665435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.676741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb7ff9-03b3-4a0f-abed-ad58ba47dd7c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.681871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09692f-9fff-4447-821a-1dee68fba727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.682429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09692f-9fff-4447-821a-1dee68fba727 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.682713 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09692f-9fff-4447-821a-1dee68fba727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.682988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09692f-9fff-4447-821a-1dee68fba727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.683641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09692f-9fff-4447-821a-1dee68fba727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.685239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09692f-9fff-4447-821a-1dee68fba727 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.697571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1017/2062] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:18.702324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.713863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014cea-44a7-4b6a-b746-e2b91b76ddac admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.719091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.719947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.720366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.721860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] PATH_INFO: `/v3/projects/c5a70f48e97d4cc89dadf29709089e5b/users/79bdc04701f54602ad31a312f6d2e578/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.738262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a70f48e97d4cc89dadf29709089e5b, user_id=79bdc04701f54602ad31a312f6d2e578, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.743530 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.762968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1046/2063] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:18 2022] PUT /identity/v3/projects/c5a70f48e97d4cc89dadf29709089e5b/users/79bdc04701f54602ad31a312f6d2e578/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:18.774003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb315499-f4c4-4dd7-b91a-e01d7da96e9b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.774336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb315499-f4c4-4dd7-b91a-e01d7da96e9b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.774604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb315499-f4c4-4dd7-b91a-e01d7da96e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.807367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-eb315499-f4c4-4dd7-b91a-e01d7da96e9b None None] MFA Rules not processed for user `79bdc04701f54602ad31a312f6d2e578`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:18.808593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-eb315499-f4c4-4dd7-b91a-e01d7da96e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:18.880995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1018/2064] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:18.885347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:18.956027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fea140-2665-4742-a04e-5eae793a3d68 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:18.961026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:18.961626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:18.961911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:18.962217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:18.962850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:18.964799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:18.992209 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1047/2065] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:18 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:18.996414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb315499-f4c4-4dd7-b91a-e01d7da96e9b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:19.007593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb315499-f4c4-4dd7-b91a-e01d7da96e9b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:19.059048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:19.067275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:19.067890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:19.068764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:19.068764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:19.069098 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:19.071049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:19.092050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1019/2066] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:18 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:19.096549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:19.106916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fdf0d-1dd2-4c94-a676-944708a9b542 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:19.111723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:19.112316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:19.112598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:19.112871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:19.113511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:19.115133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:19.128653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1048/2067] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:19.130993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:19.141487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97d43-0cc5-4bf8-a491-3c3792b2ab06 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:19.147077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:19.147765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:19.148044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:19.148322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] PATH_INFO: `/v3/projects/398aae33e29d4c64afb5224fdc501f2d/users/96decdd4d3b743e194d85deac521393d/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:19.164372 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398aae33e29d4c64afb5224fdc501f2d, user_id=96decdd4d3b743e194d85deac521393d, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:19.167086 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:19.180339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1020/2068] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:19 2022] PUT /identity/v3/projects/398aae33e29d4c64afb5224fdc501f2d/users/96decdd4d3b743e194d85deac521393d/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:19.184758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:19.195793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb88649-2054-49ac-b9d9-2ca65155e701 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:19.226458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:19.261902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f664b0-93b2-4c58-b1f1-bf6fb4b8926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:19.262545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f664b0-93b2-4c58-b1f1-bf6fb4b8926a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:19.262832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f664b0-93b2-4c58-b1f1-bf6fb4b8926a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:19.263105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f664b0-93b2-4c58-b1f1-bf6fb4b8926a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:19.263740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f664b0-93b2-4c58-b1f1-bf6fb4b8926a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:19.265330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f664b0-93b2-4c58-b1f1-bf6fb4b8926a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:19.276416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1049/2069] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:19.280955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:19.292249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be6520-5f88-46ff-9af0-a81ca0af10c0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:19.297732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:19.298480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:19.298776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:19.299114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] PATH_INFO: `/v3/projects/398aae33e29d4c64afb5224fdc501f2d/users/96decdd4d3b743e194d85deac521393d/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:19.301221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398aae33e29d4c64afb5224fdc501f2d, user_id=96decdd4d3b743e194d85deac521393d, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:19.303959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:19.315727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1021/2070] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:19 2022] PUT /identity/v3/projects/398aae33e29d4c64afb5224fdc501f2d/users/96decdd4d3b743e194d85deac521393d/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:19.326435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e507-fdbd-415b-828b-9b11b868166e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:19.326721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e507-fdbd-415b-828b-9b11b868166e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:19.327019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e507-fdbd-415b-828b-9b11b868166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:19.356057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1374e507-fdbd-415b-828b-9b11b868166e None None] MFA Rules not processed for user `96decdd4d3b743e194d85deac521393d`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:19.357311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1374e507-fdbd-415b-828b-9b11b868166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:19.427719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1050/2071] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:19.442745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:19.444715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:19.507634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057736a9-7ca2-4247-bf4e-560c3ff92c80 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:19.511260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:19.511863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:19.512144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:19.512417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:19.521454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:19.522954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:19.532185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1022/2072] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:19.960452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e507-fdbd-415b-828b-9b11b868166e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:20.034673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e507-fdbd-415b-828b-9b11b868166e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:20.036527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:20.037971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.039479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:20.040115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.040396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.040666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] PATH_INFO: `/v3/users/79bdc04701f54602ad31a312f6d2e578` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.041805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bdc04701f54602ad31a312f6d2e578)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:20.043906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:20.092718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bdc04701f54602ad31a312f6d2e578'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.094864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ba10-de2d-434d-a230-7e2134ca4cca service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:20.098543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0952bc9-af91-4290-a7d7-5b7c225266ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:20.099147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0952bc9-af91-4290-a7d7-5b7c225266ac service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.099429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0952bc9-af91-4290-a7d7-5b7c225266ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.099708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0952bc9-af91-4290-a7d7-5b7c225266ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.100240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:20.101464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d0952bc9-af91-4290-a7d7-5b7c225266ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.109546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bdc04701f54602ad31a312f6d2e578'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.110257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bdc04701f54602ad31a312f6d2e578'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.110929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bdc04701f54602ad31a312f6d2e578'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.113998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0952bc9-af91-4290-a7d7-5b7c225266ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:20.115448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0952bc9-af91-4290-a7d7-5b7c225266ac service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:20.118830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bdc04701f54602ad31a312f6d2e578'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.125879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1023/2073] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:20.132224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1051/2074] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:19 2022] DELETE /identity/v3/users/79bdc04701f54602ad31a312f6d2e578 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:20.136570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea879-3651-4dad-a1a8-8d5bd76f3b97 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.136861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea879-3651-4dad-a1a8-8d5bd76f3b97 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.137139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea879-3651-4dad-a1a8-8d5bd76f3b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.157083 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bfbea879-3651-4dad-a1a8-8d5bd76f3b97 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:20.158400 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bfbea879-3651-4dad-a1a8-8d5bd76f3b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.207042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:20.220444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1024/2075] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:20.230321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:20.233158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.297871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.298191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.299022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.300586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143905b-a0b0-4ab6-af70-9954d53e7bee admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:20.306144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:20.306144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.306144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.306144 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.326435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:20.328232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:20.331275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:20.332512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.341888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1052/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:20.440889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:20.443519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.447425 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1025/2077] 10.222.0.18 () {58 vars in 967 bytes} [Sun Oct 23 20:11:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:20.467572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5b387-00bf-4310-aa2c-63d8ddfa744e service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:20.468870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:20.470938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.476050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:20.476678 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.476960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.477395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.479573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.499953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:20.501959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:20.514499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1053/2078] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:20.560359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89f86b-8c08-49ac-bbca-1980ccdf77ba None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:20.568547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:20.570044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.570643 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.570769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.584341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:20.586027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:20.596042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1026/2079] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:11:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 20:11:20.679696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:20.682758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:20.703082 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65205a5-0fad-44a0-9f28-913866a7dfa9 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:20.708693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:20.709334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.709615 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.709891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] PATH_INFO: `/v3/projects/c5a70f48e97d4cc89dadf29709089e5b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.711115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a70f48e97d4cc89dadf29709089e5b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:20.713299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:20.776434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a70f48e97d4cc89dadf29709089e5b', 'request_id': 'req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.789006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a70f48e97d4cc89dadf29709089e5b', 'request_id': 'req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.799763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a70f48e97d4cc89dadf29709089e5b', 'request_id': 'req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.820617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] The token cache is being invalidate because project c5a70f48e97d4cc89dadf29709089e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:20.821257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.822013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:20.824387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1054/2080] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:20 2022] DELETE /identity/v3/projects/c5a70f48e97d4cc89dadf29709089e5b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:20.830211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:20.856367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584507-c173-4edb-83a4-8f0c8de5013a service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:20.951173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:20.952177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:20.956254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:20.956676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] PATH_INFO: `/v3/users/96decdd4d3b743e194d85deac521393d` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:20.962633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96decdd4d3b743e194d85deac521393d)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:20.964180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:21.032752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:21.051693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96decdd4d3b743e194d85deac521393d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.061450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96decdd4d3b743e194d85deac521393d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.070627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96decdd4d3b743e194d85deac521393d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.071320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96decdd4d3b743e194d85deac521393d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.088442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-aa2714ae-858b-4868-98c9-85d24fe704c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96decdd4d3b743e194d85deac521393d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.098261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1027/2081] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:20 2022] DELETE /identity/v3/users/96decdd4d3b743e194d85deac521393d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:21.397431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:21.398771 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:21.414969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588c8ae-628d-4ced-88a1-b6b263fdcbe3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:21.464767 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:21.484946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:21.485696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.485977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.486299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] PATH_INFO: `/v3/projects/398aae33e29d4c64afb5224fdc501f2d` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.487435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] RBAC: Authorizing `identity:delete_project(project_id=398aae33e29d4c64afb5224fdc501f2d)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:21.489344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:21.542870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398aae33e29d4c64afb5224fdc501f2d', 'request_id': 'req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.550205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398aae33e29d4c64afb5224fdc501f2d', 'request_id': 'req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.559671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398aae33e29d4c64afb5224fdc501f2d', 'request_id': 'req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.572240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] The token cache is being invalidate because project 398aae33e29d4c64afb5224fdc501f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:21.572484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.573106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6d711ed6-3d93-4bbe-be6d-0b2d744e551b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:21.574917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1055/2082] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:21 2022] DELETE /identity/v3/projects/398aae33e29d4c64afb5224fdc501f2d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:21.580337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bec98-4b06-4d31-9c71-56d354060d75 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.580857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bec98-4b06-4d31-9c71-56d354060d75 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.581101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bec98-4b06-4d31-9c71-56d354060d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.601870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1b5bec98-4b06-4d31-9c71-56d354060d75 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:21.603134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1b5bec98-4b06-4d31-9c71-56d354060d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:21.666826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1028/2083] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:21.676193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17654708-dcd9-4e36-989e-4d901ac68a85 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.676606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17654708-dcd9-4e36-989e-4d901ac68a85 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.676993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17654708-dcd9-4e36-989e-4d901ac68a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.698448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-17654708-dcd9-4e36-989e-4d901ac68a85 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:21.699763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17654708-dcd9-4e36-989e-4d901ac68a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:21.708635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1056/2084] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:21.712793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bec98-4b06-4d31-9c71-56d354060d75 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:21.723803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bec98-4b06-4d31-9c71-56d354060d75 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:21.728623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:21.729231 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.729510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.729779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.730464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:21.730769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:21.732394 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:21.748147 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1029/2085] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:21.749303 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17654708-dcd9-4e36-989e-4d901ac68a85 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:21.760111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17654708-dcd9-4e36-989e-4d901ac68a85 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:21.765576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:21.766218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.766504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.766812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.768047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:21.770110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:21.800013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1057/2086] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:21 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:21.804581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:21.815235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099336c-78e8-4ab9-9c4c-9a7ed6265e8a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:21.880707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:21.880707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.880707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.880707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.881111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:21.883151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:21.909885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1030/2087] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:21 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:21.914035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:21.925865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2361f-0415-47db-9165-9e434d6e9b1c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:21.931126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:21.931978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.933600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.933884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.934592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:21.936226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:21.947886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1058/2088] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:21.952166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:21.965010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4a04e-b093-442e-99ee-3575a8b83c4e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:21.969744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7304ee8-8910-4206-8631-bc58ec6d1eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:21.971036 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7304ee8-8910-4206-8631-bc58ec6d1eef admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:21.971311 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7304ee8-8910-4206-8631-bc58ec6d1eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:21.971582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7304ee8-8910-4206-8631-bc58ec6d1eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:21.972230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7304ee8-8910-4206-8631-bc58ec6d1eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:21.974031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7304ee8-8910-4206-8631-bc58ec6d1eef admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:21.985546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1031/2089] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:21.990640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.003368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d1489-54fb-466a-b345-40de25a706cf admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.008784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.009542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.009900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.010273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] PATH_INFO: `/v3/projects/b4b7e3527a3249e78d39f0a6e9ba3b13/users/d512050734c140ebbdf413af2e8a3660/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.032145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b7e3527a3249e78d39f0a6e9ba3b13, user_id=d512050734c140ebbdf413af2e8a3660, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:22.038382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:22.066365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1059/2090] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:21 2022] PUT /identity/v3/projects/b4b7e3527a3249e78d39f0a6e9ba3b13/users/d512050734c140ebbdf413af2e8a3660/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:22.076964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2193f-dc65-4379-8f81-3a4309ff189b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.077324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2193f-dc65-4379-8f81-3a4309ff189b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.077812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2193f-dc65-4379-8f81-3a4309ff189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.105428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:22.109295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-dca2193f-dc65-4379-8f81-3a4309ff189b None None] MFA Rules not processed for user `d512050734c140ebbdf413af2e8a3660`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:22.112158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dca2193f-dc65-4379-8f81-3a4309ff189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:22.179638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1032/2091] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:22.184146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.262451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb99e7-5249-4e22-86ce-7002882dbfdd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.268069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.268768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.269265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.269566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.270307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:22.272245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:22.292107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:22.312344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1060/2092] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:22 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:22.313707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2193f-dc65-4379-8f81-3a4309ff189b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.325442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2193f-dc65-4379-8f81-3a4309ff189b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.394592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.395113 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.395815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.395815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.396381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:22.398323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:22.440690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1033/2093] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:22 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:22.441897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.453220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1861-a970-4278-8be8-0f8584bef6d2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.458602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.459334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.459717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.460015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.460721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:22.462489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:22.474127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1061/2094] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:22.477971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.503559 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4dfb-7258-4a65-ae10-194e73e1b4a9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.510351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.511615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.512098 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.512621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] PATH_INFO: `/v3/projects/549c36443a10460285f30bd65226008c/users/b5de90a4f82548ff89acf537d9fd6ec1/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.533830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=549c36443a10460285f30bd65226008c, user_id=b5de90a4f82548ff89acf537d9fd6ec1, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:22.536598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:22.552088 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1034/2095] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:22 2022] PUT /identity/v3/projects/549c36443a10460285f30bd65226008c/users/b5de90a4f82548ff89acf537d9fd6ec1/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:22.556026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.567849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d351e-ee9f-478b-aa2d-14bcf38b2003 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.645518 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8efa8-ee03-4c59-b046-acfb388f0947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.646172 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8efa8-ee03-4c59-b046-acfb388f0947 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.646455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8efa8-ee03-4c59-b046-acfb388f0947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.646728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8efa8-ee03-4c59-b046-acfb388f0947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.647538 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8efa8-ee03-4c59-b046-acfb388f0947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:22.649617 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8efa8-ee03-4c59-b046-acfb388f0947 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:22.662131 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1062/2096] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:22.666243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.679406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c57313-9731-4bb4-8e8e-e8d8c2a993bd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.684461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.685136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.685419 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.685696 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] PATH_INFO: `/v3/projects/549c36443a10460285f30bd65226008c/users/b5de90a4f82548ff89acf537d9fd6ec1/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.687967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549c36443a10460285f30bd65226008c, user_id=b5de90a4f82548ff89acf537d9fd6ec1, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:22.691458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:22.703028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1035/2097] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:22 2022] PUT /identity/v3/projects/549c36443a10460285f30bd65226008c/users/b5de90a4f82548ff89acf537d9fd6ec1/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:22.715194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def788-012e-4d4b-8e6d-79c8cf466b74 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.715756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def788-012e-4d4b-8e6d-79c8cf466b74 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.716223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def788-012e-4d4b-8e6d-79c8cf466b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:22.747497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-89def788-012e-4d4b-8e6d-79c8cf466b74 None None] MFA Rules not processed for user `b5de90a4f82548ff89acf537d9fd6ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:22.748743 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-89def788-012e-4d4b-8e6d-79c8cf466b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:22.857779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1063/2098] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:22.866798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:22.869790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:22.974478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c00726-3341-45c7-bb5f-ae815dcd6b51 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:22.984249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2d48-ef52-49ec-b1cd-dd556c682f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:22.984898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2d48-ef52-49ec-b1cd-dd556c682f96 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:22.985160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2d48-ef52-49ec-b1cd-dd556c682f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:22.985430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2d48-ef52-49ec-b1cd-dd556c682f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:23.009485 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2d48-ef52-49ec-b1cd-dd556c682f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:23.011081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2d48-ef52-49ec-b1cd-dd556c682f96 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:23.016031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:23.029270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1036/2099] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:23.242667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def788-012e-4d4b-8e6d-79c8cf466b74 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:23.355223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def788-012e-4d4b-8e6d-79c8cf466b74 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:23.364552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:23.365610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:23.366049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:23.366457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] PATH_INFO: `/v3/users/d512050734c140ebbdf413af2e8a3660` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:23.368092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d512050734c140ebbdf413af2e8a3660)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:23.370428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:23.379059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:23.446863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd512050734c140ebbdf413af2e8a3660'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:23.475509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd512050734c140ebbdf413af2e8a3660'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:23.476358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd512050734c140ebbdf413af2e8a3660'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:23.476979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd512050734c140ebbdf413af2e8a3660'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:23.489480 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd512050734c140ebbdf413af2e8a3660'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:23.515824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1064/2100] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:23 2022] DELETE /identity/v3/users/d512050734c140ebbdf413af2e8a3660 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:23.521476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:23.521791 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:23.522070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:23.547126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:23.549143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:23.643558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1037/2101] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:23.652379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:23.655286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:23.800035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f2f9d-6c7f-4dfa-8093-d4cb56d948b2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:23.804042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:23.804656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:23.804932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:23.805362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:23.815640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:23.817185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:23.829006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1065/2102] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:24.906613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:24.908145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:24.920897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583480a-66b3-4b2d-98df-6313ce9dec2a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:24.927394 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:24.928022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:24.928312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:24.928741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] PATH_INFO: `/v3/projects/b4b7e3527a3249e78d39f0a6e9ba3b13` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:24.930032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b7e3527a3249e78d39f0a6e9ba3b13)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:24.932878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:25.046522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b7e3527a3249e78d39f0a6e9ba3b13', 'request_id': 'req-33fb24c1-94c5-4f54-bb03-80b12192eb07'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.070823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b7e3527a3249e78d39f0a6e9ba3b13', 'request_id': 'req-33fb24c1-94c5-4f54-bb03-80b12192eb07'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.083312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b7e3527a3249e78d39f0a6e9ba3b13', 'request_id': 'req-33fb24c1-94c5-4f54-bb03-80b12192eb07'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.101062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] The token cache is being invalidate because project b4b7e3527a3249e78d39f0a6e9ba3b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:25.101767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.102754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-33fb24c1-94c5-4f54-bb03-80b12192eb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.105011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1038/2103] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:24 2022] DELETE /identity/v3/projects/b4b7e3527a3249e78d39f0a6e9ba3b13 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:25.108571 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:25.124385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383709b3-7e2b-49e9-8548-b4ca7951f662 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:25.239994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:25.240650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:25.241057 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:25.241341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] PATH_INFO: `/v3/users/b5de90a4f82548ff89acf537d9fd6ec1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:25.242713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5de90a4f82548ff89acf537d9fd6ec1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:25.245165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:25.317102 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:25.339878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5de90a4f82548ff89acf537d9fd6ec1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.360108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5de90a4f82548ff89acf537d9fd6ec1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.361821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5de90a4f82548ff89acf537d9fd6ec1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.362759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5de90a4f82548ff89acf537d9fd6ec1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.375252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c132c84-7086-4c33-a718-6adbe17dca82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5de90a4f82548ff89acf537d9fd6ec1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.402670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1066/2104] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:25 2022] DELETE /identity/v3/users/b5de90a4f82548ff89acf537d9fd6ec1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:25.508158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ebe2d-a957-4c31-9104-4068c66223a1 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:25.508447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ebe2d-a957-4c31-9104-4068c66223a1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:25.508789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ebe2d-a957-4c31-9104-4068c66223a1 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:25.510121 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1039/2105] 10.222.0.18 () {54 vars in 961 bytes} [Sun Oct 23 20:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 20:11:25.516524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1d55-2c6e-4a7d-acf2-3c081bf75a58 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:25.516813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1d55-2c6e-4a7d-acf2-3c081bf75a58 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:25.517639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1d55-2c6e-4a7d-acf2-3c081bf75a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:25.598454 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4f3e1d55-2c6e-4a7d-acf2-3c081bf75a58 None None] MFA Rules not processed for user `f98a263de5ee43918dcb60bc1db5d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:25.599729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4f3e1d55-2c6e-4a7d-acf2-3c081bf75a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:25.632736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ebe2d-a957-4c31-9104-4068c66223a1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:25.634933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c74ebe2d-a957-4c31-9104-4068c66223a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:25.752854 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ebe2d-a957-4c31-9104-4068c66223a1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:25.758436 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:25.759362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1067/2106] 10.222.0.18 () {58 vars in 1058 bytes} [Sun Oct 23 20:11:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:25.759598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:25.760142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:25.760585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] PATH_INFO: `/v3/users/2c77f0bef97f4a3681f6f3d435efd9dd` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:25.762277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c77f0bef97f4a3681f6f3d435efd9dd)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:25.764540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:25.768846 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1d55-2c6e-4a7d-acf2-3c081bf75a58 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:25.804875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1d55-2c6e-4a7d-acf2-3c081bf75a58 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:25.805907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:25.813223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:25.814272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:25.814668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:25.815159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:25.818644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:25.844322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:25.849622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:25.871152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c77f0bef97f4a3681f6f3d435efd9dd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.880363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1068/2107] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:25.880666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c77f0bef97f4a3681f6f3d435efd9dd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.890600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c77f0bef97f4a3681f6f3d435efd9dd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.892405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c77f0bef97f4a3681f6f3d435efd9dd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.946884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c77f0bef97f4a3681f6f3d435efd9dd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:25.957657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1040/2108] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:25 2022] DELETE /identity/v3/users/2c77f0bef97f4a3681f6f3d435efd9dd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:26.188058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.199296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef55402-ca78-4092-9f72-f16e7b912c19 service placement] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.285826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.286604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.286962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.287245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] PATH_INFO: `/v3/projects/b3ab9c4ad37344b082ed508415ba4add` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.288463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ab9c4ad37344b082ed508415ba4add)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.290475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.298688 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.300360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.314263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a5105-3db5-4519-ad2f-e5d02ac78add admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.319150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.319780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.320241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.320601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] PATH_INFO: `/v3/projects/549c36443a10460285f30bd65226008c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.321956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549c36443a10460285f30bd65226008c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.323905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.344132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:26.379294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ab9c4ad37344b082ed508415ba4add', 'request_id': 'req-d40e9fa7-2062-48a6-a87a-30c3d2927f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.386649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ab9c4ad37344b082ed508415ba4add', 'request_id': 'req-d40e9fa7-2062-48a6-a87a-30c3d2927f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.398494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ab9c4ad37344b082ed508415ba4add', 'request_id': 'req-d40e9fa7-2062-48a6-a87a-30c3d2927f66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.410550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549c36443a10460285f30bd65226008c', 'request_id': 'req-70bdec63-705d-4892-9711-d9d6b53584a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.411194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] The token cache is being invalidate because project b3ab9c4ad37344b082ed508415ba4add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:26.411530 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.412182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.413886 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1069/2109] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:26 2022] DELETE /identity/v3/projects/b3ab9c4ad37344b082ed508415ba4add => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:26.414616 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.415970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.419228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549c36443a10460285f30bd65226008c', 'request_id': 'req-70bdec63-705d-4892-9711-d9d6b53584a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.426921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549c36443a10460285f30bd65226008c', 'request_id': 'req-70bdec63-705d-4892-9711-d9d6b53584a2'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.438398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] The token cache is being invalidate because project 549c36443a10460285f30bd65226008c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:26.438920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.440085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-70bdec63-705d-4892-9711-d9d6b53584a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.441604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1041/2110] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:26 2022] DELETE /identity/v3/projects/549c36443a10460285f30bd65226008c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:26.445022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437604-b088-4d20-8b9a-b3b7015e1c0d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.445022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437604-b088-4d20-8b9a-b3b7015e1c0d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.445022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437604-b088-4d20-8b9a-b3b7015e1c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.464056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-25437604-b088-4d20-8b9a-b3b7015e1c0d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:26.465248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-25437604-b088-4d20-8b9a-b3b7015e1c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.484873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e9fa7-2062-48a6-a87a-30c3d2927f66 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.535062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1042/2111] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:26.540558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75793587-b943-4c7f-8222-3cd2b33c17c0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.540984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75793587-b943-4c7f-8222-3cd2b33c17c0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.541322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75793587-b943-4c7f-8222-3cd2b33c17c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.544205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.544909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.545212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.545478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] PATH_INFO: `/v3/users/2e4843b52aa8440a8ec485d103932ecb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.546618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4843b52aa8440a8ec485d103932ecb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.549026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.562267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-75793587-b943-4c7f-8222-3cd2b33c17c0 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:26.563747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-75793587-b943-4c7f-8222-3cd2b33c17c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.571997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1043/2112] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:26.575393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b621-330b-405d-ad03-5a38b1f6d8c9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.575983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b621-330b-405d-ad03-5a38b1f6d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.576293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b621-330b-405d-ad03-5a38b1f6d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.597737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-abc0b621-330b-405d-ad03-5a38b1f6d8c9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:26.598943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-abc0b621-330b-405d-ad03-5a38b1f6d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.604552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4843b52aa8440a8ec485d103932ecb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.615062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1044/2113] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:26.619634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b731-d685-4f29-9aa3-e85680b725d6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.619944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b731-d685-4f29-9aa3-e85680b725d6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.620214 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b731-d685-4f29-9aa3-e85680b725d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.620360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4843b52aa8440a8ec485d103932ecb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.621083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4843b52aa8440a8ec485d103932ecb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.621708 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4843b52aa8440a8ec485d103932ecb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.625424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:26.631499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4843b52aa8440a8ec485d103932ecb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:26.643288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9606b731-d685-4f29-9aa3-e85680b725d6 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:26.644472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9606b731-d685-4f29-9aa3-e85680b725d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.646115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1070/2114] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:26 2022] DELETE /identity/v3/users/2e4843b52aa8440a8ec485d103932ecb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:26.647012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.648343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.653022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:26.717717 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1045/2115] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:26.722148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b731-d685-4f29-9aa3-e85680b725d6 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.723974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1098386-6b09-4e1e-b006-4c11ac2756f0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.729187 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.729793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.730353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.730353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.731246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:26.731347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b731-d685-4f29-9aa3-e85680b725d6 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.731554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.733145 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.736795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.737960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.738292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.738575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.739229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:26.739539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.741165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.746882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1071/2116] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:26.751068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.763743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1046/2117] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:11:26.764855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.766786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640382-b834-4b77-9f6d-b34c1f4fc447 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.774233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.775105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.775105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.775349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.775563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f580e-9ba3-4433-8e2a-0270442a2bb6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.775988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.778117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.780741 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.781434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.782012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.782012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.782699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.785183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.810621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1072/2118] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:26.816043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.821666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1047/2119] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:26.826327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.904663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9585d-61a9-411d-9883-112201bc44b5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.925985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca173-0927-4b4a-8589-bab0b1ace61a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.931457 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.932310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.932695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.933094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.933842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.936408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.964909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1048/2120] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:26.965862 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:26.969926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:26.973203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.973874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.974198 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.974500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.975199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.977258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:26.982795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432127b-59c1-4dbf-b037-c924b9b2f5a8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:26.988248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:26.988868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:26.989173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:26.989528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] PATH_INFO: `/v3/projects/e6b8ffc6ac844c339356c77881c7ea50` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:26.989948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:26.990921 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b8ffc6ac844c339356c77881c7ea50)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:26.993308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.003341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1073/2121] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:26 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:27.004243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.014778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4478a-b852-451c-a1ee-7b89cfe1e3ad admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.019397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.019977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.020795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.021073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.021737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.023358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.034348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1074/2122] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.035422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.044586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b8ffc6ac844c339356c77881c7ea50', 'request_id': 'req-a562de6a-23f3-4e79-a34a-16dbb53b041a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:27.047593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aec2b-36a1-4a20-a673-e4fc9240a7e5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.052412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b8ffc6ac844c339356c77881c7ea50', 'request_id': 'req-a562de6a-23f3-4e79-a34a-16dbb53b041a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:27.060133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b8ffc6ac844c339356c77881c7ea50', 'request_id': 'req-a562de6a-23f3-4e79-a34a-16dbb53b041a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:27.061622 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:27.075061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] The token cache is being invalidate because project e6b8ffc6ac844c339356c77881c7ea50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:27.075476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:27.076222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:27.078072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1049/2123] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:26 2022] DELETE /identity/v3/projects/e6b8ffc6ac844c339356c77881c7ea50 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:27.079093 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.081649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:27.108204 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8adac6-e0bd-4fbc-b208-ed9f9c894d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.108840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8adac6-e0bd-4fbc-b208-ed9f9c894d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.109130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8adac6-e0bd-4fbc-b208-ed9f9c894d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.109399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8adac6-e0bd-4fbc-b208-ed9f9c894d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.110033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8adac6-e0bd-4fbc-b208-ed9f9c894d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.112158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8adac6-e0bd-4fbc-b208-ed9f9c894d9f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.121727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1075/2124] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.124519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.124910 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.125208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.145391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:27.146659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:27.147971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562de6a-23f3-4e79-a34a-16dbb53b041a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.152563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393e85-3c19-4946-b100-21a24678dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.153166 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393e85-3c19-4946-b100-21a24678dca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.153446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393e85-3c19-4946-b100-21a24678dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.153718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393e85-3c19-4946-b100-21a24678dca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.154396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393e85-3c19-4946-b100-21a24678dca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.154640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1076/2125] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:27.155407 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.155993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393e85-3c19-4946-b100-21a24678dca5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.156636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:27.168314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c00e80-0101-46cf-89cb-ed4b2d749a3b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.173833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1050/2126] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.173833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fbc1f-0a06-47f0-aaa9-0b27c852e379 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.173833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fbc1f-0a06-47f0-aaa9-0b27c852e379 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.173833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fbc1f-0a06-47f0-aaa9-0b27c852e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.177385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.178281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.178561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.178865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.179602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.181244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.196223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1077/2127] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.196834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-419fbc1f-0a06-47f0-aaa9-0b27c852e379 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:27.196969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.197063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-419fbc1f-0a06-47f0-aaa9-0b27c852e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:27.203415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1051/2128] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:27.203757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62cc69-c1d2-4775-8127-57b94d0a4b19 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.204171 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fbc1f-0a06-47f0-aaa9-0b27c852e379 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.208680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.209318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.209598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.209871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] PATH_INFO: `/v3/projects/de121c8911334deca5f8242f220a294a/users/67841c4aa2a34b29ab1873a80c14e432/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.213850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fbc1f-0a06-47f0-aaa9-0b27c852e379 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.218503 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f6e9a-a200-42b3-8ed0-3bd300297561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.219139 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6e9a-a200-42b3-8ed0-3bd300297561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.219422 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6e9a-a200-42b3-8ed0-3bd300297561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.219699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6e9a-a200-42b3-8ed0-3bd300297561 admin admin] PATH_INFO: `/v3/projects/c988813f5e18403bbee368527879215e/users/3d7d29ea83704ba98ed7653b4af7ccc3/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.224928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de121c8911334deca5f8242f220a294a, user_id=67841c4aa2a34b29ab1873a80c14e432, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.227634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.234987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f6e9a-a200-42b3-8ed0-3bd300297561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c988813f5e18403bbee368527879215e, user_id=3d7d29ea83704ba98ed7653b4af7ccc3, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.238822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f6e9a-a200-42b3-8ed0-3bd300297561 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.241153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1078/2129] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:27 2022] PUT /identity/v3/projects/de121c8911334deca5f8242f220a294a/users/67841c4aa2a34b29ab1873a80c14e432/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:27.241960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.264308 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1052/2130] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:27 2022] PUT /identity/v3/projects/c988813f5e18403bbee368527879215e/users/3d7d29ea83704ba98ed7653b4af7ccc3/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:27.266323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962cfd-8d3a-4200-a2e9-4399122946dd None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.266821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962cfd-8d3a-4200-a2e9-4399122946dd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.267159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962cfd-8d3a-4200-a2e9-4399122946dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.297371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-57962cfd-8d3a-4200-a2e9-4399122946dd None None] MFA Rules not processed for user `67841c4aa2a34b29ab1873a80c14e432`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:27.299066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-57962cfd-8d3a-4200-a2e9-4399122946dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:27.313740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528b71c-019f-4e7d-8819-171fa6985dd7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.359507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:27.367327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1053/2131] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:27.368613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbf52-7046-4783-b5d7-1580d54cfa1b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.368931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbf52-7046-4783-b5d7-1580d54cfa1b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.369201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbf52-7046-4783-b5d7-1580d54cfa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.377134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.377737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.378018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.378446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.379094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:27.379399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.381024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.396387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1079/2132] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:27.396387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.399875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-689dbf52-7046-4783-b5d7-1580d54cfa1b None None] MFA Rules not processed for user `3d7d29ea83704ba98ed7653b4af7ccc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:27.401106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-689dbf52-7046-4783-b5d7-1580d54cfa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:27.404355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a163d-7ce4-472e-8aa1-5d406f0bb725 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.409795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.410410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.410686 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.410957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.411605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.413487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.435405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:27.443119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1080/2133] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:27.444002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.475672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1054/2134] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:27.475672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dbf52-7046-4783-b5d7-1580d54cfa1b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.483586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dbf52-7046-4783-b5d7-1580d54cfa1b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.507761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836b118-657a-4942-858a-f6ac7ad51d5a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.512845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.513586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.513876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.515378 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.516012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.518354 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.541793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.542444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.542724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.542997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.543650 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.544850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1081/2135] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:27.545640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.545749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.568547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1055/2136] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:27.569261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.579091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd901a0-297e-44a1-953c-48d1e2b0d0eb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.620588 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b0fa8-dcae-4c68-98ec-8944f41ea87d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.625332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.625964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.626815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.627106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.627763 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.629702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.636529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.637145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.637427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.637704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.638365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.640272 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.657222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1082/2137] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:27.657222 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.661684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1056/2138] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:27.662533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.672234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117a7fd-f952-4166-a2ae-e32065112c24 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.690361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:27.723029 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:27.723258 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745f219-1458-4968-9f77-cfd81ad5c329 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.728671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.729273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.729635 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.729823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.730499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.732102 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.732863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.733462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.733738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.734011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.734662 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.737749 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.742735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1083/2139] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.743594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.754385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae56de-7365-4e48-81b4-6ac71da21e9a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.759170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.762691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1057/2140] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:27.762826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.762826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.762826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.763184 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.763274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.763274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.771046 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a0a1-38cf-4214-bcb9-5fe16028634f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.774140 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1084/2141] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.774945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.778678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.779278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.779569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.779835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.780475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.782122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.785552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763017-b466-467c-92a8-9aa94f351f7a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.790336 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.790933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.791214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.791484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.792108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.793763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1058/2142] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.793880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.797344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.807593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1085/2143] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.807593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.810273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1072c1-b6af-4d83-873c-65b4109581eb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.815355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a9c1-c90d-41d7-ad7e-8113999791f6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.816070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.816737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.816964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.817240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.817957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.819735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.820044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.820667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.820949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.821219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] PATH_INFO: `/v3/projects/a5f25c19dc344fba827fd37423025f7b/users/cfbd6511daaa4cd99187ab3fd8d36da5/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.830780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1059/2144] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.831571 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.836483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f25c19dc344fba827fd37423025f7b, user_id=cfbd6511daaa4cd99187ab3fd8d36da5, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.839322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.843660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36e36-48fe-430c-a0b2-75f1d8fd3df6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.849310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.849964 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.850312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.850590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] PATH_INFO: `/v3/projects/ef026f4d14d24319b39229c18429d483/users/f73a57cdeb08482190305578ec4e5504/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.854366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1086/2145] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:27 2022] PUT /identity/v3/projects/a5f25c19dc344fba827fd37423025f7b/users/cfbd6511daaa4cd99187ab3fd8d36da5/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:27.859042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.866317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef026f4d14d24319b39229c18429d483, user_id=f73a57cdeb08482190305578ec4e5504, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.869132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.884476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1060/2146] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:27 2022] PUT /identity/v3/projects/ef026f4d14d24319b39229c18429d483/users/f73a57cdeb08482190305578ec4e5504/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:27.888474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:27.945821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632161e-9d3e-4413-8c93-ff4fde00c336 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.958982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fb540-3319-4179-8c8f-f9912b70d8bc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:27.963773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3cf5e-80d9-408b-af6e-2e55f0c60fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:27.964381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3cf5e-80d9-408b-af6e-2e55f0c60fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.964660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3cf5e-80d9-408b-af6e-2e55f0c60fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.964933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3cf5e-80d9-408b-af6e-2e55f0c60fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:27.965575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3cf5e-80d9-408b-af6e-2e55f0c60fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:27.967192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3cf5e-80d9-408b-af6e-2e55f0c60fbc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:27.978811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1061/2147] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:27.982976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edecdeb-9795-4ba4-936c-4642b19a9175 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:27.983267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edecdeb-9795-4ba4-936c-4642b19a9175 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:27.983538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edecdeb-9795-4ba4-936c-4642b19a9175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.007073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.007734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.008013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.008287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] PATH_INFO: `/v3/projects/fb341c15fb3a4909a57702a44097a064/users/a96e9bc57d9a4d9b8a0380db72a2ed12/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.012012 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3edecdeb-9795-4ba4-936c-4642b19a9175 None None] MFA Rules not processed for user `cfbd6511daaa4cd99187ab3fd8d36da5`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:28.013211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3edecdeb-9795-4ba4-936c-4642b19a9175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:28.023214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb341c15fb3a4909a57702a44097a064, user_id=a96e9bc57d9a4d9b8a0380db72a2ed12, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.025906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.040168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1087/2148] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:27 2022] PUT /identity/v3/projects/fb341c15fb3a4909a57702a44097a064/users/a96e9bc57d9a4d9b8a0380db72a2ed12/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:28.040751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.050328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:28.087275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1062/2149] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:28.090908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904833b6-a4e3-4f17-9079-3f24a4e1391b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.090908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904833b6-a4e3-4f17-9079-3f24a4e1391b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.090908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904833b6-a4e3-4f17-9079-3f24a4e1391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.108404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f94b-64f6-420e-b84f-389da90252ba admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.113143 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.113791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.114068 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.114373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] PATH_INFO: `/v3/projects/ef026f4d14d24319b39229c18429d483/users/f73a57cdeb08482190305578ec4e5504/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.116272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef026f4d14d24319b39229c18429d483, user_id=f73a57cdeb08482190305578ec4e5504, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.116788 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-904833b6-a4e3-4f17-9079-3f24a4e1391b None None] MFA Rules not processed for user `a96e9bc57d9a4d9b8a0380db72a2ed12`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:28.117990 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-904833b6-a4e3-4f17-9079-3f24a4e1391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:28.118953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.127972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:28.129801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1088/2150] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:28 2022] PUT /identity/v3/projects/ef026f4d14d24319b39229c18429d483/users/f73a57cdeb08482190305578ec4e5504/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:28.138914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.187381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1063/2151] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:28.192547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a99f7-e2d2-49e4-9f67-98e17b957412 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.192547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a99f7-e2d2-49e4-9f67-98e17b957412 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.192547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a99f7-e2d2-49e4-9f67-98e17b957412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.209693 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb208d-e259-4e76-8a41-f37fa3235293 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.214397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.214996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.215278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.215551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.216184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.217255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a25a99f7-e2d2-49e4-9f67-98e17b957412 None None] MFA Rules not processed for user `f73a57cdeb08482190305578ec4e5504`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:28.218091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.218484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a25a99f7-e2d2-49e4-9f67-98e17b957412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:28.246666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1089/2152] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:28 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:28.247751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.303691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1064/2153] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:28.304508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a99f7-e2d2-49e4-9f67-98e17b957412 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.315913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a99f7-e2d2-49e4-9f67-98e17b957412 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.320613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.321198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.321479 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.321754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.322410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.323983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9221e4a-cb71-4eb5-8fd4-c4b6df532da4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.324307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.328672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.329272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.330331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.330609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.331239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.333130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.347609 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1065/2154] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:28 2022] POST /identity/v3/users => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:28.348369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.349954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:28.367193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1090/2155] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:28 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:28.367193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.380981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:28.414890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c640d5-8810-43e3-9e1c-fbbce87d2ca9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.444078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54df42-a35c-4c92-9f0e-3eb985257bb9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.448749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.449347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.449666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.449888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.450033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:28.450559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.452620 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.464300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1091/2156] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:28.465166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.468840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.469451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.469731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.470004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.476321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04b85-f7a3-4adb-a290-2efd8869c605 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.481135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.481707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.481982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.482280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.482901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.484798 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.509715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1092/2157] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:28 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:28.509715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.519375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b92a-951d-4292-be1d-3fb222c61674 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.524020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.524652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.524982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.525184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] PATH_INFO: `/v3/projects/ce6d21fd5a3342b88be81f65f1d8fa67/users/a7a1be9aeab248869aac3c2f07a34e0b/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.535085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.536727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.540982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6d21fd5a3342b88be81f65f1d8fa67, user_id=a7a1be9aeab248869aac3c2f07a34e0b, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.544560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.547560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1066/2158] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:28 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:28.550722 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.560056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1093/2159] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:28 2022] PUT /identity/v3/projects/ce6d21fd5a3342b88be81f65f1d8fa67/users/a7a1be9aeab248869aac3c2f07a34e0b/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:28.563570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b860fb5-f08d-40ca-9aa0-3580c2e8e9da service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.564755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.650070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d49c5-fd52-4d4a-9bf4-c1ad84023f2e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.654875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.655473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.655750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.656017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.656659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.659788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.662954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.663635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.663986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.664333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.665123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.666913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.674720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1094/2160] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:28.678442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.685192 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1067/2161] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:28.690333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.691630 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3980-f4e8-4338-b350-a93d4e062831 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.696367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.697049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.697332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.697605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] PATH_INFO: `/v3/projects/ce6d21fd5a3342b88be81f65f1d8fa67/users/a7a1be9aeab248869aac3c2f07a34e0b/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.700024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6d21fd5a3342b88be81f65f1d8fa67, user_id=a7a1be9aeab248869aac3c2f07a34e0b, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.701684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f889d4-14cd-4e68-994c-35823ad2ac7b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.702837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.714111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1095/2162] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:28 2022] PUT /identity/v3/projects/ce6d21fd5a3342b88be81f65f1d8fa67/users/a7a1be9aeab248869aac3c2f07a34e0b/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:28.716523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f815-b4d8-44c3-9930-93f42fdccc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.717186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f815-b4d8-44c3-9930-93f42fdccc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.717474 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f815-b4d8-44c3-9930-93f42fdccc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.717754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f815-b4d8-44c3-9930-93f42fdccc6f admin admin] PATH_INFO: `/v3/projects/0f26eda1f40c4663afaee82829ea63e2/users/7fcf5992fac84b6cbe62e041146ff9e9/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.719385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.737172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f815-b4d8-44c3-9930-93f42fdccc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f26eda1f40c4663afaee82829ea63e2, user_id=7fcf5992fac84b6cbe62e041146ff9e9, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.740059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f815-b4d8-44c3-9930-93f42fdccc6f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.755035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1068/2163] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:28 2022] PUT /identity/v3/projects/0f26eda1f40c4663afaee82829ea63e2/users/7fcf5992fac84b6cbe62e041146ff9e9/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:28.759420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71af82-4109-4e1e-8301-1beb4e20f00c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.759692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71af82-4109-4e1e-8301-1beb4e20f00c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.759982 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71af82-4109-4e1e-8301-1beb4e20f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.774228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:28.787029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02285e0-d93f-4b44-97ca-f21e99e375e3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.790200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2a71af82-4109-4e1e-8301-1beb4e20f00c None None] MFA Rules not processed for user `a7a1be9aeab248869aac3c2f07a34e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:28.791444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2a71af82-4109-4e1e-8301-1beb4e20f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:28.837458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:28.847098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.847762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.848064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.848325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] PATH_INFO: `/v3/users/3d7d29ea83704ba98ed7653b4af7ccc3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.849462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7d29ea83704ba98ed7653b4af7ccc3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.851423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.863202 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1069/2164] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:28.864042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71af82-4109-4e1e-8301-1beb4e20f00c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.876354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71af82-4109-4e1e-8301-1beb4e20f00c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:28.881742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:28.882402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:28.882668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:28.882997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:28.883823 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:28.885585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:28.895955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1070/2165] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:28.896783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.900347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7d29ea83704ba98ed7653b4af7ccc3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:28.913042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7d29ea83704ba98ed7653b4af7ccc3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:28.913744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7d29ea83704ba98ed7653b4af7ccc3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:28.914439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7d29ea83704ba98ed7653b4af7ccc3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:28.922293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7d29ea83704ba98ed7653b4af7ccc3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:28.939900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1096/2166] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:28 2022] DELETE /identity/v3/users/3d7d29ea83704ba98ed7653b4af7ccc3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:28.939900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:28.939900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:28.952952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8e62d-7f3f-45a1-8ea6-6ed1099d51d5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:29.004782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c7df-69cd-47ac-a366-e49edc7e3df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:29.005484 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c7df-69cd-47ac-a366-e49edc7e3df0 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.005654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c7df-69cd-47ac-a366-e49edc7e3df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.005928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c7df-69cd-47ac-a366-e49edc7e3df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.007756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9e8c7df-69cd-47ac-a366-e49edc7e3df0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:29.008511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a597bcf-06f4-43a9-a550-f591e734b4e8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:29.013334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b83e-1f49-408c-91c1-0d6f0822cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:29.013995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b83e-1f49-408c-91c1-0d6f0822cd19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.014387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b83e-1f49-408c-91c1-0d6f0822cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.014606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b83e-1f49-408c-91c1-0d6f0822cd19 admin admin] PATH_INFO: `/v3/projects/0f26eda1f40c4663afaee82829ea63e2/users/7fcf5992fac84b6cbe62e041146ff9e9/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.016552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b83e-1f49-408c-91c1-0d6f0822cd19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f26eda1f40c4663afaee82829ea63e2, user_id=7fcf5992fac84b6cbe62e041146ff9e9, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:29.019349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b83e-1f49-408c-91c1-0d6f0822cd19 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:29.030607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1097/2167] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:28 2022] PUT /identity/v3/projects/0f26eda1f40c4663afaee82829ea63e2/users/7fcf5992fac84b6cbe62e041146ff9e9/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:29.031909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.032197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.032474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.053394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:29.054636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:29.059630 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:29.070265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c7df-69cd-47ac-a366-e49edc7e3df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:29.071691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c7df-69cd-47ac-a366-e49edc7e3df0 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:29.081032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1071/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:29.082035 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.082349 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.082641 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.110491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] MFA Rules not processed for user `7fcf5992fac84b6cbe62e041146ff9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:29.112270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:29.119769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1098/2169] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:29.130622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:29.131998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:29.148672 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:29.196266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1072/2170] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:29.198359 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e18f-9f2b-4160-923f-66449858b85b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:29.202295 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:29.202968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.203311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.203649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.212187 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:29.213650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:29.214149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:29.215233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:29.228029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1099/2171] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:29.294733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be98ad-3f8c-4af1-ace5-f183d6b82789 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:29.299415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:29.300119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.300560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.300849 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.313094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:29.314792 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:29.325178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1073/2172] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:29.550873 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:29.552312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:29.565604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3535c-8f3a-42e9-96d2-67f3fad74ba8 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:29.571799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:29.572505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.572867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.573146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] PATH_INFO: `/v3/projects/c988813f5e18403bbee368527879215e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.574592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c988813f5e18403bbee368527879215e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:29.576697 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:29.634481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c988813f5e18403bbee368527879215e', 'request_id': 'req-38541fed-796c-424c-8271-4ea7756d2929'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.640874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c988813f5e18403bbee368527879215e', 'request_id': 'req-38541fed-796c-424c-8271-4ea7756d2929'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.650031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c988813f5e18403bbee368527879215e', 'request_id': 'req-38541fed-796c-424c-8271-4ea7756d2929'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.661589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] The token cache is being invalidate because project c988813f5e18403bbee368527879215e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:29.661904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.663083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.664228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1100/2173] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:29 2022] DELETE /identity/v3/projects/c988813f5e18403bbee368527879215e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:29.668387 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:29.680872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05787e-3f04-4f4c-b521-c6334090ec56 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:29.749961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:29.749961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:29.749961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:29.749961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] PATH_INFO: `/v3/users/f73a57cdeb08482190305578ec4e5504` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:29.750388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73a57cdeb08482190305578ec4e5504)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:29.752337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:29.801317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73a57cdeb08482190305578ec4e5504'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.809351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73a57cdeb08482190305578ec4e5504'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.818458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73a57cdeb08482190305578ec4e5504'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.819106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73a57cdeb08482190305578ec4e5504'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.826494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:29.834045 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-00b20715-4eaa-4d5a-94ac-e1beea4a07eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73a57cdeb08482190305578ec4e5504'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:29.842326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1074/2174] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:29 2022] DELETE /identity/v3/users/f73a57cdeb08482190305578ec4e5504 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:30.137998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.139483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:30.153490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541fed-796c-424c-8271-4ea7756d2929 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.194501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:30.224219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.224876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.225325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.225606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] PATH_INFO: `/v3/projects/ef026f4d14d24319b39229c18429d483` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.226903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef026f4d14d24319b39229c18429d483)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.228902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.283188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef026f4d14d24319b39229c18429d483', 'request_id': 'req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:30.289740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef026f4d14d24319b39229c18429d483', 'request_id': 'req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:30.299164 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef026f4d14d24319b39229c18429d483', 'request_id': 'req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:30.310820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] The token cache is being invalidate because project ef026f4d14d24319b39229c18429d483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:30.310998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:30.311658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-13ceeb68-55dd-4028-a9d3-f4fc99fb4519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:30.313385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1101/2175] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:30 2022] DELETE /identity/v3/projects/ef026f4d14d24319b39229c18429d483 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:30.318412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee80ac-34d0-4d6c-a818-af293fbd72df None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.318879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee80ac-34d0-4d6c-a818-af293fbd72df None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.318996 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee80ac-34d0-4d6c-a818-af293fbd72df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.342019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9eee80ac-34d0-4d6c-a818-af293fbd72df None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:30.343262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9eee80ac-34d0-4d6c-a818-af293fbd72df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:30.412660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1075/2176] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:30.420123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00a2f-22b6-4211-8de8-dcdf2a3922bb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.420411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00a2f-22b6-4211-8de8-dcdf2a3922bb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.420689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00a2f-22b6-4211-8de8-dcdf2a3922bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.441941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-76a00a2f-22b6-4211-8de8-dcdf2a3922bb None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:30.443215 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-76a00a2f-22b6-4211-8de8-dcdf2a3922bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:30.452012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1102/2177] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:30.456795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee80ac-34d0-4d6c-a818-af293fbd72df None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.468204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee80ac-34d0-4d6c-a818-af293fbd72df None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.475037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.475037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.475037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.475037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.475404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:30.475680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.477270 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.504215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1076/2178] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:30.505688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00a2f-22b6-4211-8de8-dcdf2a3922bb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.516540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00a2f-22b6-4211-8de8-dcdf2a3922bb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.522524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.523232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.523576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.523934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.524636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.526703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.566119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1103/2179] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:30 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:30.568288 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.580833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4068f-869f-4abb-876f-00b69dbaddfa admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.667096 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.668040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.668323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.668632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.669262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.676638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.685804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.688201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:30.700100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1077/2180] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:30 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:30.704067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.715771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0507-e60d-4b0c-9d72-cb09e70f080d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.722747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.723353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.723635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.723912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.724737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.726825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.741563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1078/2181] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:30.742633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.752925 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea5128-fd11-44a1-a252-c94f2a38b371 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.757646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.758306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.758494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.758748 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ae65c-2aff-4451-890b-170c31167905 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.758887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.759547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.761415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.763208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.764319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.764601 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.764869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.766868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:30.776022 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1079/2182] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:30.778546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.788621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9089a-759f-48a0-b1b3-e5cb8e025930 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.793381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65553c89-ee75-4a50-9d3b-c0dad21bc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.794032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553c89-ee75-4a50-9d3b-c0dad21bc547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.794364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553c89-ee75-4a50-9d3b-c0dad21bc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.794634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553c89-ee75-4a50-9d3b-c0dad21bc547 admin admin] PATH_INFO: `/v3/projects/ec45852c74b34341913da9d1333ef9b6/users/b1f1b96ac21645cb846f0d07b7cb4ab6/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.817572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65553c89-ee75-4a50-9d3b-c0dad21bc547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec45852c74b34341913da9d1333ef9b6, user_id=b1f1b96ac21645cb846f0d07b7cb4ab6, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.820708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65553c89-ee75-4a50-9d3b-c0dad21bc547 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.835556 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1080/2183] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:30 2022] PUT /identity/v3/projects/ec45852c74b34341913da9d1333ef9b6/users/b1f1b96ac21645cb846f0d07b7cb4ab6/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:30.838028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:30.844212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.846032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040250b-0b5b-40f1-9c3f-e8488a51c15b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.846188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.846462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040250b-0b5b-40f1-9c3f-e8488a51c15b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.846815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040250b-0b5b-40f1-9c3f-e8488a51c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.861921 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1104/2184] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:30.862904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.864243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:30.878178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b040250b-0b5b-40f1-9c3f-e8488a51c15b None None] MFA Rules not processed for user `b1f1b96ac21645cb846f0d07b7cb4ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:30.879404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b040250b-0b5b-40f1-9c3f-e8488a51c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:30.879628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835988-09e1-4f11-a5d4-2cf89c440c82 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.887861 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:30.943010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.943750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.944095 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.944391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] PATH_INFO: `/v3/users/a96e9bc57d9a4d9b8a0380db72a2ed12` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.945587 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96e9bc57d9a4d9b8a0380db72a2ed12)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.947691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:30.959386 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1081/2185] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:30.963591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040250b-0b5b-40f1-9c3f-e8488a51c15b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:30.975768 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040250b-0b5b-40f1-9c3f-e8488a51c15b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:30.982109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:30.982844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:30.983241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:30.983608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:30.984305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:30.987424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.013158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96e9bc57d9a4d9b8a0380db72a2ed12'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.022552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1082/2186] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:30 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:31.026331 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.031402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96e9bc57d9a4d9b8a0380db72a2ed12'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.032365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96e9bc57d9a4d9b8a0380db72a2ed12'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.033481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96e9bc57d9a4d9b8a0380db72a2ed12'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.043575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9b2d141-035c-4182-a993-3bb04b61e177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96e9bc57d9a4d9b8a0380db72a2ed12'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.068887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1105/2187] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:30 2022] DELETE /identity/v3/users/a96e9bc57d9a4d9b8a0380db72a2ed12 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:31.074371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.074932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.075597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.104824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:31.106867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.121718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a85e-87c1-4cfc-940a-43cd2b4ddcd4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.193972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.194621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.194942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.195337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.196133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.197712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1106/2188] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:31.201066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.208554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.210433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.228284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:31.234247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1083/2189] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:31 2022] POST /identity/v3/users => generated 307 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:31.237488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.239894 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.256462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3cb0b-b37b-414e-bfba-021bd44c9917 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.261304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.262195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.262757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.263263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.264162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.266064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.280026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1084/2190] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:31.281034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.283523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127b4b-de5c-45ef-86ea-37f370d0c69e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.287749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.288402 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.288735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.289010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.293447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477c435-0616-4d4b-ab0d-a6c1acd9b907 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.299562 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.300211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.300497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.300771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] PATH_INFO: `/v3/projects/a94665579bfb4306ad5754e6aafcb2d7/users/31e924b083054fdf8757daf3a1b1ec51/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.302387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.305779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.313465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:31.319316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1107/2191] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:31.319472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94665579bfb4306ad5754e6aafcb2d7, user_id=31e924b083054fdf8757daf3a1b1ec51, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.322067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.340112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1085/2192] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:31 2022] PUT /identity/v3/projects/a94665579bfb4306ad5754e6aafcb2d7/users/31e924b083054fdf8757daf3a1b1ec51/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:31.344308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.355703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a14a5-8470-45b3-9022-2ea89fd0aff0 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.418960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453b6a6-4b4f-4315-8953-538311fe8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.419592 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b6a6-4b4f-4315-8953-538311fe8883 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.419837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b6a6-4b4f-4315-8953-538311fe8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.420105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b6a6-4b4f-4315-8953-538311fe8883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.420751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453b6a6-4b4f-4315-8953-538311fe8883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.422435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453b6a6-4b4f-4315-8953-538311fe8883 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.434179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1108/2193] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:31.439856 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.451201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab4690-8187-49ca-8071-f4320dae0734 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.457232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.457885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.458204 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.458482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] PATH_INFO: `/v3/projects/a94665579bfb4306ad5754e6aafcb2d7/users/31e924b083054fdf8757daf3a1b1ec51/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.460833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94665579bfb4306ad5754e6aafcb2d7, user_id=31e924b083054fdf8757daf3a1b1ec51, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.463514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.476381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1086/2194] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:31 2022] PUT /identity/v3/projects/a94665579bfb4306ad5754e6aafcb2d7/users/31e924b083054fdf8757daf3a1b1ec51/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:31.488203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.488491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.488766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.525159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] MFA Rules not processed for user `31e924b083054fdf8757daf3a1b1ec51`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:31.526463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.560446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.562315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.618446 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1109/2195] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:31 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:31.630704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.632162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.638557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecac1f-5d8d-4521-8935-ad7023882781 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.643935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.644611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.644844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.645109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.645824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaf6b6-ab81-4016-bcd4-5d0dd2286da3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.647322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.649761 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.650539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.650706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.650944 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.661726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.663437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.674409 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1110/2196] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:31 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:31.675320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.676695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.707819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:31.727063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.728504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.738666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1087/2197] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:31.750824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce7edd-1516-4a88-8aeb-9aa43d6e31aa service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.757275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.757938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.758618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.758900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] PATH_INFO: `/v3/projects/fb341c15fb3a4909a57702a44097a064` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.760072 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb341c15fb3a4909a57702a44097a064)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.762048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.786832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.797290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acce904-9bab-49fc-a630-86c6b11e973c service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.802271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.802796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.802933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.803847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.806618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.837485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb341c15fb3a4909a57702a44097a064', 'request_id': 'req-d04d79f9-f961-4126-8706-e8b4d79f8c24'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.846687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb341c15fb3a4909a57702a44097a064', 'request_id': 'req-d04d79f9-f961-4126-8706-e8b4d79f8c24'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.857216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb341c15fb3a4909a57702a44097a064', 'request_id': 'req-d04d79f9-f961-4126-8706-e8b4d79f8c24'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.882892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.883485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] The token cache is being invalidate because project fb341c15fb3a4909a57702a44097a064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:31.883869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.884566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:31.884864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:31.886862 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1111/2198] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:31 2022] DELETE /identity/v3/projects/fb341c15fb3a4909a57702a44097a064 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:31.890914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:31.893009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:31.898037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1088/2199] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:31.962993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d79f9-f961-4126-8706-e8b4d79f8c24 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:31.967683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:31.968307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:31.968586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:31.968922 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] PATH_INFO: `/v3/users/7fcf5992fac84b6cbe62e041146ff9e9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:31.970165 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcf5992fac84b6cbe62e041146ff9e9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:31.972993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.028489 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcf5992fac84b6cbe62e041146ff9e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.036067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:32.043324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcf5992fac84b6cbe62e041146ff9e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.044339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcf5992fac84b6cbe62e041146ff9e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.046217 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcf5992fac84b6cbe62e041146ff9e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.054616 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c4c9c4a-6d1f-4656-a58a-08f8be6002b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcf5992fac84b6cbe62e041146ff9e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.070581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1112/2200] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:31 2022] DELETE /identity/v3/users/7fcf5992fac84b6cbe62e041146ff9e9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:32.349942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:32.362429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acd78c-84a0-4684-8b7c-961b95886d6b service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:32.383620 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:32.421965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:32.422631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.422913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.423694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] PATH_INFO: `/v3/projects/0f26eda1f40c4663afaee82829ea63e2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.425253 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f26eda1f40c4663afaee82829ea63e2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:32.427174 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.475106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f26eda1f40c4663afaee82829ea63e2', 'request_id': 'req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.480978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f26eda1f40c4663afaee82829ea63e2', 'request_id': 'req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.489026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f26eda1f40c4663afaee82829ea63e2', 'request_id': 'req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.500280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] The token cache is being invalidate because project 0f26eda1f40c4663afaee82829ea63e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:32.500472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.501031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9ebb26fd-d3d4-4b8b-bccc-10dd83f1644b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:32.503612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1089/2201] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:32 2022] DELETE /identity/v3/projects/0f26eda1f40c4663afaee82829ea63e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:32.508224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173d4c-6188-40ba-9150-af21feecf272 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.508662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173d4c-6188-40ba-9150-af21feecf272 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.508895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173d4c-6188-40ba-9150-af21feecf272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.528403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9b173d4c-6188-40ba-9150-af21feecf272 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:32.529629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9b173d4c-6188-40ba-9150-af21feecf272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:32.589013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1113/2202] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:32.598728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d04d7-f88e-4e84-b230-46e5a6c649f7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.599016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d04d7-f88e-4e84-b230-46e5a6c649f7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.599295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d04d7-f88e-4e84-b230-46e5a6c649f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.619775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-682d04d7-f88e-4e84-b230-46e5a6c649f7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:32.620966 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-682d04d7-f88e-4e84-b230-46e5a6c649f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:32.628850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1090/2203] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:32.633035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173d4c-6188-40ba-9150-af21feecf272 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:32.643219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173d4c-6188-40ba-9150-af21feecf272 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:32.647737 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:32.648321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.648600 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.648868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.649520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:32.649807 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:32.651436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.663544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1114/2204] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:32.667698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d04d7-f88e-4e84-b230-46e5a6c649f7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:32.677494 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d04d7-f88e-4e84-b230-46e5a6c649f7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:32.682124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:32.682717 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.682997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.683271 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.683909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:32.685802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.712437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1091/2205] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:32 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:32.716522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:32.727514 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19091ab-0064-40dc-8edb-d2307c5d675e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:32.782991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:32.783775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.784052 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.784323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.784942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:32.786864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.807940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1115/2206] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:32 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:32.812061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:32.822893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac11d1-61d7-4cb7-9c16-b6549aa09bf1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:32.827580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:32.828201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.828481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.828754 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.829401 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:32.831159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.840901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1092/2207] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:32.844802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:32.855329 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe8c0-a8f1-434d-be68-bee8803d912f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:32.859799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be6bef-bf7b-4526-9000-f9b629bddf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:32.860405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be6bef-bf7b-4526-9000-f9b629bddf55 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.861234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be6bef-bf7b-4526-9000-f9b629bddf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.861516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be6bef-bf7b-4526-9000-f9b629bddf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.862171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be6bef-bf7b-4526-9000-f9b629bddf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:32.863745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be6bef-bf7b-4526-9000-f9b629bddf55 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.875316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1116/2208] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:32.879636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:32.889596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c0505-d68d-42b6-87df-58dd2d2aee05 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:32.896063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:32.896765 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.897042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.897313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] PATH_INFO: `/v3/projects/fc7e30c35e484e09921923e003630c2f/users/37a3911fe4b24dbaa0f92e59c6c5fe72/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.915782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7e30c35e484e09921923e003630c2f, user_id=37a3911fe4b24dbaa0f92e59c6c5fe72, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:32.918420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:32.932796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1093/2209] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:32 2022] PUT /identity/v3/projects/fc7e30c35e484e09921923e003630c2f/users/37a3911fe4b24dbaa0f92e59c6c5fe72/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:32.943473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9413-7dd0-471c-a7ff-4740370983fe None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:32.943626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9413-7dd0-471c-a7ff-4740370983fe None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:32.943899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9413-7dd0-471c-a7ff-4740370983fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:32.973127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e50c9413-7dd0-471c-a7ff-4740370983fe None None] MFA Rules not processed for user `37a3911fe4b24dbaa0f92e59c6c5fe72`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:32.974370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e50c9413-7dd0-471c-a7ff-4740370983fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:33.004012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:33.048795 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1117/2210] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:33.053087 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.108118 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:33.121144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992700d-f1c0-4744-835f-e52bebf81092 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.126619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.126619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.127010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.127342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.128042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.130030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.166240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1094/2211] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:33 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:33.170110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9413-7dd0-471c-a7ff-4740370983fe None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.185230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9413-7dd0-471c-a7ff-4740370983fe None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.253967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.254671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.255019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.255358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.256062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.258193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.280462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1118/2212] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:33 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:33.285131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.295610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656f3de-6db8-4ef3-b130-56b8d4623f55 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.300414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.301014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.301299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.301579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.302254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.303840 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.319572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1095/2213] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:33.320687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.332025 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c72e-0173-4728-87fe-7976634154fa admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.337199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.337837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.338136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.338413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] PATH_INFO: `/v3/projects/f3aa2499570344a8a752198495500897/users/8c623bed0df94e46984e99084719b69b/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.354709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aa2499570344a8a752198495500897, user_id=8c623bed0df94e46984e99084719b69b, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.357262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.374157 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1119/2214] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:33 2022] PUT /identity/v3/projects/f3aa2499570344a8a752198495500897/users/8c623bed0df94e46984e99084719b69b/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:33.375580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.386226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9002a-5193-4205-ad2a-54c0894f5f5c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.450120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766729d-6a00-4fb2-ba2b-071515a02f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.450779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766729d-6a00-4fb2-ba2b-071515a02f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.451008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766729d-6a00-4fb2-ba2b-071515a02f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.451282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766729d-6a00-4fb2-ba2b-071515a02f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.452191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766729d-6a00-4fb2-ba2b-071515a02f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.453509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766729d-6a00-4fb2-ba2b-071515a02f1d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.464606 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1096/2215] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:33.468913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.479993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d7245-66c7-45df-af0e-fe2a2b24f031 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.484787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.485432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.485789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.486032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] PATH_INFO: `/v3/projects/f3aa2499570344a8a752198495500897/users/8c623bed0df94e46984e99084719b69b/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.488005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aa2499570344a8a752198495500897, user_id=8c623bed0df94e46984e99084719b69b, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.490749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.504387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1120/2216] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:33 2022] PUT /identity/v3/projects/f3aa2499570344a8a752198495500897/users/8c623bed0df94e46984e99084719b69b/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:33.519753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed586f-952c-49b6-b8e7-c97341daaba0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.520048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed586f-952c-49b6-b8e7-c97341daaba0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.520327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed586f-952c-49b6-b8e7-c97341daaba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.549718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4bed586f-952c-49b6-b8e7-c97341daaba0 None None] MFA Rules not processed for user `8c623bed0df94e46984e99084719b69b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:33.550994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4bed586f-952c-49b6-b8e7-c97341daaba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:33.628924 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1097/2217] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:33.641272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.643317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:33.702822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1083a-453e-4e5d-8a3c-38c3d526be64 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.707574 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.708173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.708449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.708718 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.717754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.719211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.729547 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1121/2218] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:33.801955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed586f-952c-49b6-b8e7-c97341daaba0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:33.811481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed586f-952c-49b6-b8e7-c97341daaba0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:33.815505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e79265-03fc-46e0-91a8-d7f352e2fe62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:33.816097 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e79265-03fc-46e0-91a8-d7f352e2fe62 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:33.816381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e79265-03fc-46e0-91a8-d7f352e2fe62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:33.816659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e79265-03fc-46e0-91a8-d7f352e2fe62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:33.860831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:33.873801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e79265-03fc-46e0-91a8-d7f352e2fe62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:33.875389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e79265-03fc-46e0-91a8-d7f352e2fe62 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:33.884863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1098/2219] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:34.153003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:34.179294 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:34.219700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72f4a-588c-4288-814b-b16bcacfb5d1 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:34.224278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:34.224903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:34.225176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:34.225445 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] PATH_INFO: `/v3/users/37a3911fe4b24dbaa0f92e59c6c5fe72` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:34.226586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a3911fe4b24dbaa0f92e59c6c5fe72)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:34.228469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:34.276929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a3911fe4b24dbaa0f92e59c6c5fe72'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.290280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a3911fe4b24dbaa0f92e59c6c5fe72'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.290982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a3911fe4b24dbaa0f92e59c6c5fe72'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.292063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a3911fe4b24dbaa0f92e59c6c5fe72'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.300090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a3911fe4b24dbaa0f92e59c6c5fe72'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.313000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1122/2220] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:34 2022] DELETE /identity/v3/users/37a3911fe4b24dbaa0f92e59c6c5fe72 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:34.318115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:34.318466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:34.318805 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:34.340736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:34.341931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:34.408545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1099/2221] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:34.418428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:34.420268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:34.479396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35db5-7233-4af6-9466-aa48cedc2c54 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:34.483149 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:34.483757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:34.484039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:34.484315 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:34.494522 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:34.495957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:34.505832 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1123/2222] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:34.799671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:34.801328 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:34.815813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426a2bd-439f-4dff-b8e8-7b4dc5932d1d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:34.821042 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:34.821930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:34.822227 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:34.822633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] PATH_INFO: `/v3/projects/fc7e30c35e484e09921923e003630c2f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:34.823794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7e30c35e484e09921923e003630c2f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:34.825728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:34.878126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7e30c35e484e09921923e003630c2f', 'request_id': 'req-9637a92b-73bd-448b-8d97-185ec878c607'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.885075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7e30c35e484e09921923e003630c2f', 'request_id': 'req-9637a92b-73bd-448b-8d97-185ec878c607'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.894050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7e30c35e484e09921923e003630c2f', 'request_id': 'req-9637a92b-73bd-448b-8d97-185ec878c607'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.904230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] The token cache is being invalidate because project fc7e30c35e484e09921923e003630c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:34.904519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.905156 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:34.906842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1100/2223] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:34 2022] DELETE /identity/v3/projects/fc7e30c35e484e09921923e003630c2f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:34.910851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:34.920360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21713e2-9836-44d5-805f-33028e1d5c90 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:34.965061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:34.980683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:34.981366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:34.981643 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:34.981913 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] PATH_INFO: `/v3/users/8c623bed0df94e46984e99084719b69b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:34.983054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c623bed0df94e46984e99084719b69b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:34.985061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.035599 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c623bed0df94e46984e99084719b69b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.047525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c623bed0df94e46984e99084719b69b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.048232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c623bed0df94e46984e99084719b69b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.048838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c623bed0df94e46984e99084719b69b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.056871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f26f83d2-5387-4ba1-b06c-8611207e07bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c623bed0df94e46984e99084719b69b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.071610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1124/2224] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:34 2022] DELETE /identity/v3/users/8c623bed0df94e46984e99084719b69b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:35.347260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.348786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:35.365654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637a92b-73bd-448b-8d97-185ec878c607 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.423700 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.424350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.424632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.424916 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] PATH_INFO: `/v3/projects/f3aa2499570344a8a752198495500897` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.426051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3aa2499570344a8a752198495500897)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.428027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.438518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:35.475361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3aa2499570344a8a752198495500897', 'request_id': 'req-639631d0-014a-4435-b8fe-7446f883227a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.481293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3aa2499570344a8a752198495500897', 'request_id': 'req-639631d0-014a-4435-b8fe-7446f883227a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.489026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3aa2499570344a8a752198495500897', 'request_id': 'req-639631d0-014a-4435-b8fe-7446f883227a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.499332 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] The token cache is being invalidate because project f3aa2499570344a8a752198495500897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:35.499626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.500333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-639631d0-014a-4435-b8fe-7446f883227a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.502550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1101/2225] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:35 2022] DELETE /identity/v3/projects/f3aa2499570344a8a752198495500897 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:35.507384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7168-b692-4adb-bdaa-8295092296c7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.507658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7168-b692-4adb-bdaa-8295092296c7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.507937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7168-b692-4adb-bdaa-8295092296c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.528291 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e92d7168-b692-4adb-bdaa-8295092296c7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:35.529486 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e92d7168-b692-4adb-bdaa-8295092296c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:35.587898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1125/2226] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:35.597614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48298a78-4807-4d10-ad53-9228c959feee None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.597901 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48298a78-4807-4d10-ad53-9228c959feee None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.598245 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48298a78-4807-4d10-ad53-9228c959feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.619718 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-48298a78-4807-4d10-ad53-9228c959feee None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:35.620902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-48298a78-4807-4d10-ad53-9228c959feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:35.629644 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1102/2227] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:35.633962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7168-b692-4adb-bdaa-8295092296c7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.644512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7168-b692-4adb-bdaa-8295092296c7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.649549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.650179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.650457 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.650727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.651370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:35.651667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.653255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.667027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1126/2228] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:35.671216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48298a78-4807-4d10-ad53-9228c959feee None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.681942 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48298a78-4807-4d10-ad53-9228c959feee None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.684791 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.686525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:35.686656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.687212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.687489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.688011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.688706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.691141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.699952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b674b2a-ace7-4a64-86c5-54dab0407bea admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.704716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.705330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.705607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.705874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] PATH_INFO: `/v3/users/67841c4aa2a34b29ab1873a80c14e432` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.707029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=67841c4aa2a34b29ab1873a80c14e432)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.708992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.723530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1103/2229] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:35 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:35.724818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.760342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67841c4aa2a34b29ab1873a80c14e432'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.761558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:35.776741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67841c4aa2a34b29ab1873a80c14e432'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.777478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67841c4aa2a34b29ab1873a80c14e432'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.778101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67841c4aa2a34b29ab1873a80c14e432'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.786382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3d5d5cbf-f848-415b-ac71-e6016e087d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67841c4aa2a34b29ab1873a80c14e432'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:35.792900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c906957-6dd7-4814-87c7-1656e087c22c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.797660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.798847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.799242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.799521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.799809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1127/2230] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:35 2022] DELETE /identity/v3/users/67841c4aa2a34b29ab1873a80c14e432 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:35.800216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.802200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.804171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.804455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.804838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.827465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1104/2231] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:35 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:35.827762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:35.827762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:35.829025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.831149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:35.843784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7465f-40a6-49e5-9a34-174a5bc9abbf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.893188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1128/2232] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:35.904137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.904584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.904748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.905031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.905307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.905952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:35.906050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.908130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.909537 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:35.925886 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1105/2233] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:35.926802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.937290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0a5a-2753-4a46-9bdf-3f9a2c0eb228 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.942984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.943668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.943853 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.944126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.944771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.946383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.957814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1106/2234] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:35.962415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:35.972927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce9b70-a545-4ee7-9239-a2aa14012f86 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.976183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24be4a4-abea-496e-a6c8-d6d2bba9db20 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:35.978890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.979543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.979824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.980100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] PATH_INFO: `/v3/projects/88e4ab4371954c11a83276246990828b/users/efb35579b3304659ad3fc72dbcadcb71/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.981752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63898b72-d11a-4a8a-8491-4a040407decd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:35.982462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63898b72-d11a-4a8a-8491-4a040407decd service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:35.982803 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63898b72-d11a-4a8a-8491-4a040407decd service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:35.983134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63898b72-d11a-4a8a-8491-4a040407decd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:35.995021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63898b72-d11a-4a8a-8491-4a040407decd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.996373 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e4ab4371954c11a83276246990828b, user_id=efb35579b3304659ad3fc72dbcadcb71, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:35.996552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63898b72-d11a-4a8a-8491-4a040407decd service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:35.999730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.008980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1129/2235] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:36.019793 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1107/2236] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:35 2022] PUT /identity/v3/projects/88e4ab4371954c11a83276246990828b/users/efb35579b3304659ad3fc72dbcadcb71/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:36.030939 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.031216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.031547 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.064728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] MFA Rules not processed for user `efb35579b3304659ad3fc72dbcadcb71`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:36.066114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.105634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:36.107919 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.146178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:36.152360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1130/2237] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:36.164227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:36.165755 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.205691 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858c200-5cd0-45ff-b5e2-ff254dafe00d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:36.214757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:36.215643 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.216124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.216784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] PATH_INFO: `/v3/users/b1f1b96ac21645cb846f0d07b7cb4ab6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.217624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f1b96ac21645cb846f0d07b7cb4ab6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:36.219646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.238965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ec421-f8d8-4709-a694-6272c8130792 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:36.243889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:36.244636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.244836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.245051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.256984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:36.258727 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.269023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1131/2238] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:36.278757 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f1b96ac21645cb846f0d07b7cb4ab6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.286441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f1b96ac21645cb846f0d07b7cb4ab6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.291874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:36.297385 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f1b96ac21645cb846f0d07b7cb4ab6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.298629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f1b96ac21645cb846f0d07b7cb4ab6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.305406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43513a44-d274-40d3-a8e3-aef6a919fcf8 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:36.310797 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:36.311536 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.311868 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.312142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] PATH_INFO: `/v3/users/efb35579b3304659ad3fc72dbcadcb71` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.314490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb35579b3304659ad3fc72dbcadcb71)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:36.317533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.318279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-29fc151b-4e8c-44df-8517-81f5c94e4fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f1b96ac21645cb846f0d07b7cb4ab6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.325190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1108/2239] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:36 2022] DELETE /identity/v3/users/b1f1b96ac21645cb846f0d07b7cb4ab6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:36.329710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92ab11-777a-4736-86b5-2283efa8e694 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.330009 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92ab11-777a-4736-86b5-2283efa8e694 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.330391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92ab11-777a-4736-86b5-2283efa8e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.358826 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ec92ab11-777a-4736-86b5-2283efa8e694 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:36.360164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ec92ab11-777a-4736-86b5-2283efa8e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.381815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb35579b3304659ad3fc72dbcadcb71'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.394236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb35579b3304659ad3fc72dbcadcb71'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.394936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb35579b3304659ad3fc72dbcadcb71'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.395562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb35579b3304659ad3fc72dbcadcb71'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.399060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:36.404710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb35579b3304659ad3fc72dbcadcb71'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.419133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1132/2240] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:36 2022] DELETE /identity/v3/users/efb35579b3304659ad3fc72dbcadcb71 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:36.420006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:36.421360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.428424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1109/2241] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:36.431401 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.431837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.432818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.453538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:36.455698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.487369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26ebc-0903-4da2-bb17-7ec913181bce admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:36.492137 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:36.492766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.493050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.493331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] PATH_INFO: `/v3/projects/de121c8911334deca5f8242f220a294a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.494501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de121c8911334deca5f8242f220a294a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:36.496415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.512893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:36.521345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1110/2242] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:36.522428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:36.523761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.548241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de121c8911334deca5f8242f220a294a', 'request_id': 'req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.554394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de121c8911334deca5f8242f220a294a', 'request_id': 'req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.561955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de121c8911334deca5f8242f220a294a', 'request_id': 'req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.573935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] The token cache is being invalidate because project de121c8911334deca5f8242f220a294a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:36.574331 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.574991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.576751 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1133/2243] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:36 2022] DELETE /identity/v3/projects/de121c8911334deca5f8242f220a294a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:36.577263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:36.578756 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.584623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf18a54-1205-4933-a20c-cfa17617c0b7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:36.635200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:36.635842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.636127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.636404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.638303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.644618 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9143c-7f61-40b9-abce-b51c4c5d0ee8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:36.648283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:36.649229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.649509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.649782 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.651573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.693181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:36.708210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:36.709646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.716874 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:36.718330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.719586 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1111/2244] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:36.720938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:36.722361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:36.728980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1134/2245] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:36.734617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c61e1-23bc-4ad6-bec7-65b17b13eb10 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:36.739518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:36.740144 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:36.740427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:36.740704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] PATH_INFO: `/v3/users/cfbd6511daaa4cd99187ab3fd8d36da5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:36.741846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbd6511daaa4cd99187ab3fd8d36da5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:36.743825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:36.792960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbd6511daaa4cd99187ab3fd8d36da5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.800354 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbd6511daaa4cd99187ab3fd8d36da5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.808057 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbd6511daaa4cd99187ab3fd8d36da5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.808743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbd6511daaa4cd99187ab3fd8d36da5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.823987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbd6511daaa4cd99187ab3fd8d36da5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:36.831398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1112/2246] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:36 2022] DELETE /identity/v3/users/cfbd6511daaa4cd99187ab3fd8d36da5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:37.131545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.133053 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:37.151870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5f849-099a-49c9-b8b8-059d4f216429 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.214624 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:37.220152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.221608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:37.232477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.233221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.233598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.233973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] PATH_INFO: `/v3/projects/88e4ab4371954c11a83276246990828b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.235348 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e4ab4371954c11a83276246990828b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.237942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:37.293060 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e4ab4371954c11a83276246990828b', 'request_id': 'req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.299404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e4ab4371954c11a83276246990828b', 'request_id': 'req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.307118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e4ab4371954c11a83276246990828b', 'request_id': 'req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.310837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9ca0a-24aa-429b-afdb-5e7e1edad299 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.319079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] The token cache is being invalidate because project 88e4ab4371954c11a83276246990828b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:37.319375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.320024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.321598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1135/2247] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:37 2022] DELETE /identity/v3/projects/88e4ab4371954c11a83276246990828b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:37.325312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.325312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:37.371191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.371814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.372092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.372361 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] PATH_INFO: `/v3/projects/ec45852c74b34341913da9d1333ef9b6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.373493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec45852c74b34341913da9d1333ef9b6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.375413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:37.383997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:37.389682 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4bdbb-81b4-4f95-bc64-fade6f1f568f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.395705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.396299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.396580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.396849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] PATH_INFO: `/v3/projects/a5f25c19dc344fba827fd37423025f7b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.397971 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f25c19dc344fba827fd37423025f7b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.399924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:37.425456 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec45852c74b34341913da9d1333ef9b6', 'request_id': 'req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.431800 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec45852c74b34341913da9d1333ef9b6', 'request_id': 'req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.440701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec45852c74b34341913da9d1333ef9b6', 'request_id': 'req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.449882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f25c19dc344fba827fd37423025f7b', 'request_id': 'req-897534f9-4b78-4f86-a9e7-69a50f271d61'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.451711 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] The token cache is being invalidate because project ec45852c74b34341913da9d1333ef9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:37.452007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.452635 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ed5ae969-5ce2-4780-bca6-8f2e304e9b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.454162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1113/2248] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:37 2022] DELETE /identity/v3/projects/ec45852c74b34341913da9d1333ef9b6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:37.457660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.457660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.457660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.457961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f25c19dc344fba827fd37423025f7b', 'request_id': 'req-897534f9-4b78-4f86-a9e7-69a50f271d61'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.465376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f25c19dc344fba827fd37423025f7b', 'request_id': 'req-897534f9-4b78-4f86-a9e7-69a50f271d61'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.479943 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] The token cache is being invalidate because project a5f25c19dc344fba827fd37423025f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:37.480416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.481058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:37.481387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.483014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:37.483801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1136/2249] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:37 2022] DELETE /identity/v3/projects/a5f25c19dc344fba827fd37423025f7b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:37.487836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.487836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:37.500560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:37.552783 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1114/2250] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:37.553708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.554206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897534f9-4b78-4f86-a9e7-69a50f271d61 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.555101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:37.563242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.565154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.565436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.565706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] PATH_INFO: `/v3/users/31e924b083054fdf8757daf3a1b1ec51` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.566965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e924b083054fdf8757daf3a1b1ec51)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.568106 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6041a-7d68-4f27-b284-5efa806e814f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.568905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:37.573179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.573790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.574065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.574369 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] PATH_INFO: `/v3/users/a7a1be9aeab248869aac3c2f07a34e0b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.575498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a1be9aeab248869aac3c2f07a34e0b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.577412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:37.624675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e924b083054fdf8757daf3a1b1ec51'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.634588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a1be9aeab248869aac3c2f07a34e0b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.637494 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e924b083054fdf8757daf3a1b1ec51'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.638324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e924b083054fdf8757daf3a1b1ec51'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.638990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e924b083054fdf8757daf3a1b1ec51'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.643158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a1be9aeab248869aac3c2f07a34e0b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.648533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d570ff15-ed64-4574-8e32-612603074c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e924b083054fdf8757daf3a1b1ec51'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.653451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a1be9aeab248869aac3c2f07a34e0b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.654441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a1be9aeab248869aac3c2f07a34e0b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.662742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1137/2251] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:37 2022] DELETE /identity/v3/users/31e924b083054fdf8757daf3a1b1ec51 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:37.666250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dcf9c-1da4-411b-87e1-b49c582e6f22 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.666250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dcf9c-1da4-411b-87e1-b49c582e6f22 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.666250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dcf9c-1da4-411b-87e1-b49c582e6f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.672284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a1be9aeab248869aac3c2f07a34e0b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:37.684729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1115/2252] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:37 2022] DELETE /identity/v3/users/a7a1be9aeab248869aac3c2f07a34e0b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:37.694837 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1f2dcf9c-1da4-411b-87e1-b49c582e6f22 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:37.696116 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1f2dcf9c-1da4-411b-87e1-b49c582e6f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:37.777595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1138/2253] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:37.778890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.791310 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b2ebf-e9da-4606-a657-1a8d77499697 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.798808 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.799549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.799898 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.800247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.801013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:37.801391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.804703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:37.809645 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:37.828234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1116/2254] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:37.833983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dcf9c-1da4-411b-87e1-b49c582e6f22 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.850253 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dcf9c-1da4-411b-87e1-b49c582e6f22 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.856520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.857141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.858141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.858444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.859224 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.861515 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:37.898816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1139/2255] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:37 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:37.903478 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:37.914241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015d853-3081-49f7-a33a-bfb7248812fd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:37.975219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:37.975952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:37.976255 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:37.976543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:37.977186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:37.979167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.006515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1117/2256] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:37 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:38.011506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.025691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e23c31-6f34-4d92-abf1-000435ebcce8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.034990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.035731 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.037438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.037854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.041729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.043740 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.062314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:38.071703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1140/2257] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:38.074531 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.075902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.078524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.096831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2e3b8-bf17-4927-a973-17e4a82884e6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.102366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60172ec-a424-4d44-ac45-382d012fc05b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.107735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.109744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.110796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.111234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.112481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.114974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.115399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.116031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.116553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.116957 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] PATH_INFO: `/v3/projects/a94665579bfb4306ad5754e6aafcb2d7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.118439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94665579bfb4306ad5754e6aafcb2d7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.121078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.134782 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1118/2258] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:38.135743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.139222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.159107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021cef-e19b-432c-8b48-515fcfde7cc8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.164803 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.165520 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.165886 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.166262 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] PATH_INFO: `/v3/projects/ce6d21fd5a3342b88be81f65f1d8fa67` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.168154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6d21fd5a3342b88be81f65f1d8fa67)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.170406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.195562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94665579bfb4306ad5754e6aafcb2d7', 'request_id': 'req-dfbd84b8-492d-4570-973d-1fbf6e0288a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.203723 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94665579bfb4306ad5754e6aafcb2d7', 'request_id': 'req-dfbd84b8-492d-4570-973d-1fbf6e0288a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.213304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94665579bfb4306ad5754e6aafcb2d7', 'request_id': 'req-dfbd84b8-492d-4570-973d-1fbf6e0288a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.231468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] The token cache is being invalidate because project a94665579bfb4306ad5754e6aafcb2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:38.231680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6d21fd5a3342b88be81f65f1d8fa67', 'request_id': 'req-9784602e-df76-418e-8e1a-0a9dea8b301c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.231801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.232669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.240437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1141/2259] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:38 2022] DELETE /identity/v3/projects/a94665579bfb4306ad5754e6aafcb2d7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:38.240437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.240437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.241744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6d21fd5a3342b88be81f65f1d8fa67', 'request_id': 'req-9784602e-df76-418e-8e1a-0a9dea8b301c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.251914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6d21fd5a3342b88be81f65f1d8fa67', 'request_id': 'req-9784602e-df76-418e-8e1a-0a9dea8b301c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.265534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] The token cache is being invalidate because project ce6d21fd5a3342b88be81f65f1d8fa67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:38.265835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.266539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9784602e-df76-418e-8e1a-0a9dea8b301c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:38.268549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1119/2260] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:38 2022] DELETE /identity/v3/projects/ce6d21fd5a3342b88be81f65f1d8fa67 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:38.269747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188c2c-ecd7-453f-a729-23c8e7ec3308 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.270030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188c2c-ecd7-453f-a729-23c8e7ec3308 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.270352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188c2c-ecd7-453f-a729-23c8e7ec3308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.292050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-27188c2c-ecd7-453f-a729-23c8e7ec3308 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:38.293261 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-27188c2c-ecd7-453f-a729-23c8e7ec3308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.315396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd84b8-492d-4570-973d-1fbf6e0288a3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.349970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:38.368944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1120/2261] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:38.372597 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ee26-0a16-495c-9425-989e903833c9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.373191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ee26-0a16-495c-9425-989e903833c9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.373566 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ee26-0a16-495c-9425-989e903833c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.380479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea01067-d4ef-4a1f-ad30-0b6284ac278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.381619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea01067-d4ef-4a1f-ad30-0b6284ac278b admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.389730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea01067-d4ef-4a1f-ad30-0b6284ac278b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.390296 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea01067-d4ef-4a1f-ad30-0b6284ac278b admin admin] PATH_INFO: `/v3/projects/610bb05c924d4c6983c1bbdb78fa9e03/users/f0b29ca8d370498da726077ed7a0a04b/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.400748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9a99ee26-0a16-495c-9425-989e903833c9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:38.402388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9a99ee26-0a16-495c-9425-989e903833c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.406824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea01067-d4ef-4a1f-ad30-0b6284ac278b admin admin] RBAC: Authorizing `identity:create_grant(project_id=610bb05c924d4c6983c1bbdb78fa9e03, user_id=f0b29ca8d370498da726077ed7a0a04b, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.409582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea01067-d4ef-4a1f-ad30-0b6284ac278b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.414565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1121/2262] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:38.416317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44db1c-bbee-4824-becf-8a5137978527 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.416628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44db1c-bbee-4824-becf-8a5137978527 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.416960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44db1c-bbee-4824-becf-8a5137978527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.424904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1142/2263] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:38 2022] PUT /identity/v3/projects/610bb05c924d4c6983c1bbdb78fa9e03/users/f0b29ca8d370498da726077ed7a0a04b/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:38.426177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c63f38-b198-4234-9d88-7561343f2102 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.426468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c63f38-b198-4234-9d88-7561343f2102 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.426741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c63f38-b198-4234-9d88-7561343f2102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.451290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1c44db1c-bbee-4824-becf-8a5137978527 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:38.452509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1c44db1c-bbee-4824-becf-8a5137978527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.454189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-64c63f38-b198-4234-9d88-7561343f2102 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:38.455471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-64c63f38-b198-4234-9d88-7561343f2102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.465714 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:38.520755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1122/2264] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:38.524528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c3986-460d-4268-a71a-60c744595444 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.524528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c3986-460d-4268-a71a-60c744595444 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.524528 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c3986-460d-4268-a71a-60c744595444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.526389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1143/2265] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:38.530362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c63f38-b198-4234-9d88-7561343f2102 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.540452 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c63f38-b198-4234-9d88-7561343f2102 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.546399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.547097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.547376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.547646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.549069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:38.549412 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.551032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.556278 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-445c3986-460d-4268-a71a-60c744595444 None None] MFA Rules not processed for user `f0b29ca8d370498da726077ed7a0a04b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:38.557516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-445c3986-460d-4268-a71a-60c744595444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.566690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1144/2266] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:38.566690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.579097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6f681-916a-44b0-87db-19497028a738 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.585368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.586058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.586429 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.586765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.587911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:38.588276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.590220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.605478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1145/2267] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:38.609750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.621570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d7bb-1e40-4009-a3da-d4084553078e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.627129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.627898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.628237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.628997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.629261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.631245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.642410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1123/2268] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:38.643499 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c3986-460d-4268-a71a-60c744595444 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.655269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c3986-460d-4268-a71a-60c744595444 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.661256 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.661755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.662040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.662352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.663006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.664971 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.671724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1146/2269] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:38.671724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.671724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:38.702527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1124/2270] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:38.702527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.753505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425e7e8-e89d-4862-bc6d-002cf5b1f533 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.769254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0e00-a312-4380-925c-42a9baf2da80 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.774164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.774843 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.775195 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.775539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.776246 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.778563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.789681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:38.803590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1125/2271] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:38.803590 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.808850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.809535 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.809887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.810265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.815206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e088a-3dd0-4a49-880d-2dad4f31f72c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.819992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.820584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.820867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.821145 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.821772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.823775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.847069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:38.850755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1126/2272] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:38.850755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.858299 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc51a2-aac7-477c-b10a-e711d09a9256 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.863347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.863976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.864257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.864547 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.865189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.866797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.872469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.873901 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.878284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1127/2273] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:38.879076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.886672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1147/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:38.887554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.888576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04e85-c7d3-4b5d-8fcf-d97ad92075cc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.894169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.894763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.895048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.895320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.896300 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.897508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.899018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938a0fb-f7c6-4763-9b66-ae162193621d service glance] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.903936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.904525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.904840 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.905130 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.905766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.908019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.912105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1128/2275] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:38.913820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.919810 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1148/2276] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:38.923841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.928613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f34ffa-a005-4b12-9a5b-bc08eac93250 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.934363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.934550 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f13429-1f8c-4adc-8247-cb8ea6bb6f8f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.935105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.935451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.935794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.936481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.938560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.940658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c84da-758d-401a-870b-7f857053c406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.941306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c84da-758d-401a-870b-7f857053c406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.941704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c84da-758d-401a-870b-7f857053c406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.942433 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c84da-758d-401a-870b-7f857053c406 admin admin] PATH_INFO: `/v3/projects/d3adaf5187a041aa9ceccc46b6e9f0ba/users/79550c1bde184987a8e83044bbe62a57/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.951191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1129/2277] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:38.955818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:38.960078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c84da-758d-401a-870b-7f857053c406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3adaf5187a041aa9ceccc46b6e9f0ba, user_id=79550c1bde184987a8e83044bbe62a57, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:38.962953 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c84da-758d-401a-870b-7f857053c406 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:38.967441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9cdb-d617-4e77-8d72-2a9373a7e144 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:38.973173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f3361-1ebb-45ec-8423-03ab22c49422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:38.973855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f3361-1ebb-45ec-8423-03ab22c49422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.974210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f3361-1ebb-45ec-8423-03ab22c49422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.974491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f3361-1ebb-45ec-8423-03ab22c49422 admin admin] PATH_INFO: `/v3/projects/78f14cfb202b4b1f8ec7c97320d134e8/users/8311284f41b34cb5a162fc850e73ad18/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.982371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1149/2278] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:38 2022] PUT /identity/v3/projects/d3adaf5187a041aa9ceccc46b6e9f0ba/users/79550c1bde184987a8e83044bbe62a57/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:38.994940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85399bb6-ec73-47d8-a126-ded3daa13946 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:38.995352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85399bb6-ec73-47d8-a126-ded3daa13946 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:38.995954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85399bb6-ec73-47d8-a126-ded3daa13946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:38.999541 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f3361-1ebb-45ec-8423-03ab22c49422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f14cfb202b4b1f8ec7c97320d134e8, user_id=8311284f41b34cb5a162fc850e73ad18, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.002539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f3361-1ebb-45ec-8423-03ab22c49422 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.019122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1130/2279] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:38 2022] PUT /identity/v3/projects/78f14cfb202b4b1f8ec7c97320d134e8/users/8311284f41b34cb5a162fc850e73ad18/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:39.023986 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007925-fd6e-4207-9214-08c7e105176f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.024376 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007925-fd6e-4207-9214-08c7e105176f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.024827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007925-fd6e-4207-9214-08c7e105176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.036073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-85399bb6-ec73-47d8-a126-ded3daa13946 None None] MFA Rules not processed for user `79550c1bde184987a8e83044bbe62a57`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:39.037973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-85399bb6-ec73-47d8-a126-ded3daa13946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:39.047280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-38007925-fd6e-4207-9214-08c7e105176f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:39.049559 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-38007925-fd6e-4207-9214-08c7e105176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:39.123575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1150/2280] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:39.127492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1131/2281] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:39.128525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85399bb6-ec73-47d8-a126-ded3daa13946 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.138185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38007925-fd6e-4207-9214-08c7e105176f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.138969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85399bb6-ec73-47d8-a126-ded3daa13946 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.140342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-38007925-fd6e-4207-9214-08c7e105176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:39.144603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.145278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.145625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.145963 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.147784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.149796 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.181647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1151/2282] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:39.185552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.212390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38007925-fd6e-4207-9214-08c7e105176f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.248202 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:39.257237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2ca40-a23f-467e-80da-b6271dd21919 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.261999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.262628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.262907 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.263193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.264290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.267384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.273179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.273878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.274268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.274607 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.285812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.287533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.291665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:39.299320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1132/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:39.300730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1152/2284] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:39 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:39.304396 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.315323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18684-75c3-4034-a034-529172e74dab service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.327945 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.328568 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.328899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.329136 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.330652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.332234 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.343758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1133/2285] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:39.348754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.361123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b0bad-3b62-4e58-8d15-44a530c71421 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.374279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.374279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.374279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.374279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] PATH_INFO: `/v3/projects/fcdecfc71c954b1d959da352d2809e47/users/289ba102494f46aa9e5de8ea4b4e7c01/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.401467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdecfc71c954b1d959da352d2809e47, user_id=289ba102494f46aa9e5de8ea4b4e7c01, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.405075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.421069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1153/2286] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:39 2022] PUT /identity/v3/projects/fcdecfc71c954b1d959da352d2809e47/users/289ba102494f46aa9e5de8ea4b4e7c01/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:39.425583 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.439290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685f343-eebc-49f1-a9f4-3deca6cc76fb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.500993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41303c33-1ac3-4d2c-8685-949763a8e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.502111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41303c33-1ac3-4d2c-8685-949763a8e78b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.502111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41303c33-1ac3-4d2c-8685-949763a8e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.502477 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41303c33-1ac3-4d2c-8685-949763a8e78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.503146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41303c33-1ac3-4d2c-8685-949763a8e78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.505059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41303c33-1ac3-4d2c-8685-949763a8e78b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.518142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1134/2287] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:39.520493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.533930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4b197-d919-443a-b2cb-7cfd9a487211 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.539529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.540285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.540642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.541214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] PATH_INFO: `/v3/projects/fcdecfc71c954b1d959da352d2809e47/users/289ba102494f46aa9e5de8ea4b4e7c01/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.543404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdecfc71c954b1d959da352d2809e47, user_id=289ba102494f46aa9e5de8ea4b4e7c01, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.546197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.562276 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1154/2288] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:39 2022] PUT /identity/v3/projects/fcdecfc71c954b1d959da352d2809e47/users/289ba102494f46aa9e5de8ea4b4e7c01/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:39.569932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425490-7639-40db-8808-04cca20a8cc5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.570281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425490-7639-40db-8808-04cca20a8cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.570546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0425490-7639-40db-8808-04cca20a8cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.613689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d0425490-7639-40db-8808-04cca20a8cc5 None None] MFA Rules not processed for user `289ba102494f46aa9e5de8ea4b4e7c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:39.614988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d0425490-7639-40db-8808-04cca20a8cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:39.706500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1135/2289] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:39.720949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:39.722904 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:39.790305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd823af-a77b-44df-83b5-7c351ee737dd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:39.793996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:39.794626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:39.794906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:39.795175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:39.858784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:39.860280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:39.872589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1155/2290] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:40.031444 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dea56b-5597-48af-8b88-55ecedc84220 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:40.032230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dea56b-5597-48af-8b88-55ecedc84220 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:40.032230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dea56b-5597-48af-8b88-55ecedc84220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:40.068452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-53dea56b-5597-48af-8b88-55ecedc84220 None None] MFA Rules not processed for user `8311284f41b34cb5a162fc850e73ad18`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:40.069874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-53dea56b-5597-48af-8b88-55ecedc84220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:40.122510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:40.172423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1136/2291] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:40.183612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:40.194179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8eb13-95ab-4c0e-b0d8-9183ff15f248 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:40.203162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:40.203711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:40.203977 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:40.204298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:40.213673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:40.215451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:40.226644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1156/2292] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:41.622927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e992-770b-4791-a0fa-0189a981cba8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:41.623402 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e992-770b-4791-a0fa-0189a981cba8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:41.623519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e992-770b-4791-a0fa-0189a981cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:41.645526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e835e992-770b-4791-a0fa-0189a981cba8 None None] MFA Rules not processed for user `8311284f41b34cb5a162fc850e73ad18`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:41.646771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e835e992-770b-4791-a0fa-0189a981cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:41.653761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1137/2293] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:41.917448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:41.918872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:41.977244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5f821-0170-4097-be98-02d81b733b17 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:41.981171 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:41.981772 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:41.982504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:41.982785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:41.985205 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:41.996472 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:41.997928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:42.006754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1157/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:44.322742 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835e992-770b-4791-a0fa-0189a981cba8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:44.333065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835e992-770b-4791-a0fa-0189a981cba8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:44.336814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:44.337489 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:44.337780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:44.338063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:44.348732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:44.350260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:44.361363 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1138/2295] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:45.147455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:45.149319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:45.158313 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:45.243824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c8dcc-9b45-43e2-9293-01439dda58ae service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:45.250456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:45.251134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:45.251956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:45.252230 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:45.253958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:45.268419 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:45.270273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:45.281510 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1158/2296] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:48.573488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:48.587103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319e9db-606d-4361-a94c-65d17241c16a service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:48.593126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca1a6-9798-4910-bee0-09b8808829e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:48.593753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca1a6-9798-4910-bee0-09b8808829e6 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:48.594032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca1a6-9798-4910-bee0-09b8808829e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:48.594359 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca1a6-9798-4910-bee0-09b8808829e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:48.596435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-03cca1a6-9798-4910-bee0-09b8808829e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:48.615636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca1a6-9798-4910-bee0-09b8808829e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:48.617281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca1a6-9798-4910-bee0-09b8808829e6 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:48.629781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1139/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:49.374453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:49.440916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb737d-1251-4d18-b500-9ef2f18917c7 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:49.445589 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:49.446250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:49.446537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:49.446817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] PATH_INFO: `/v3/users/79550c1bde184987a8e83044bbe62a57` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:49.448081 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79550c1bde184987a8e83044bbe62a57)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:49.449877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:49.502925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79550c1bde184987a8e83044bbe62a57'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:49.519919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79550c1bde184987a8e83044bbe62a57'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:49.520651 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79550c1bde184987a8e83044bbe62a57'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:49.521240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79550c1bde184987a8e83044bbe62a57'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:49.528882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79550c1bde184987a8e83044bbe62a57'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:49.545282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1159/2298] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:49 2022] DELETE /identity/v3/users/79550c1bde184987a8e83044bbe62a57 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:49.550692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:49.550981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:49.551258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:49.572080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:49.573287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:49.635384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1140/2299] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:49.645662 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:49.647219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:49.659779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:49.709747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63880d34-c7e3-4dc1-a98b-7b4cd7dc3f50 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:49.713390 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:49.713990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:49.714299 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:49.714573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:49.724993 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:49.726533 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:49.736244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1160/2300] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:50.030011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:50.031707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:50.045663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cb394-d0a7-48f3-bd8e-5ae0a234e7d5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:50.051423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:50.052068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:50.052352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:50.052699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] PATH_INFO: `/v3/projects/d3adaf5187a041aa9ceccc46b6e9f0ba` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:50.053836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3adaf5187a041aa9ceccc46b6e9f0ba)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:50.055789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:50.123080 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3adaf5187a041aa9ceccc46b6e9f0ba', 'request_id': 'req-ced8fe52-6444-481f-ae24-2ceff565bbb9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.133634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3adaf5187a041aa9ceccc46b6e9f0ba', 'request_id': 'req-ced8fe52-6444-481f-ae24-2ceff565bbb9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.141293 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3adaf5187a041aa9ceccc46b6e9f0ba', 'request_id': 'req-ced8fe52-6444-481f-ae24-2ceff565bbb9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.152222 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] The token cache is being invalidate because project d3adaf5187a041aa9ceccc46b6e9f0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:50.152516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.153206 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.155287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1141/2301] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:50 2022] DELETE /identity/v3/projects/d3adaf5187a041aa9ceccc46b6e9f0ba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:50.160269 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:50.172000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402cb8b-2247-4e34-938c-181cff47fe8e service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:50.235819 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:50.236569 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:50.236984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:50.237344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] PATH_INFO: `/v3/users/289ba102494f46aa9e5de8ea4b4e7c01` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:50.238683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289ba102494f46aa9e5de8ea4b4e7c01)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:50.240808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:50.301360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289ba102494f46aa9e5de8ea4b4e7c01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.314585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289ba102494f46aa9e5de8ea4b4e7c01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.315304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289ba102494f46aa9e5de8ea4b4e7c01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.315951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289ba102494f46aa9e5de8ea4b4e7c01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.323405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c739ce09-3e8a-479d-a317-51547b94b3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289ba102494f46aa9e5de8ea4b4e7c01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.336914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1161/2302] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:50 2022] DELETE /identity/v3/users/289ba102494f46aa9e5de8ea4b4e7c01 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:50.660401 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:50.661972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:50.687254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8fe52-6444-481f-ae24-2ceff565bbb9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:50.723213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:50.768274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:50.768909 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:50.769189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:50.769462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] PATH_INFO: `/v3/projects/fcdecfc71c954b1d959da352d2809e47` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:50.770625 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcdecfc71c954b1d959da352d2809e47)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:50.772544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:50.826472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcdecfc71c954b1d959da352d2809e47', 'request_id': 'req-98c9f38e-32aa-4331-a6bb-403f2d398188'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.835417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcdecfc71c954b1d959da352d2809e47', 'request_id': 'req-98c9f38e-32aa-4331-a6bb-403f2d398188'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.845027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcdecfc71c954b1d959da352d2809e47', 'request_id': 'req-98c9f38e-32aa-4331-a6bb-403f2d398188'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.858194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] The token cache is being invalidate because project fcdecfc71c954b1d959da352d2809e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:50.858756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.859746 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-98c9f38e-32aa-4331-a6bb-403f2d398188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:50.862248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1142/2303] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:50 2022] DELETE /identity/v3/projects/fcdecfc71c954b1d959da352d2809e47 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:50.869262 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6558225-2816-4a2d-bace-7093b6fc5971 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:50.869845 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6558225-2816-4a2d-bace-7093b6fc5971 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:50.869969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6558225-2816-4a2d-bace-7093b6fc5971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:50.891361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c6558225-2816-4a2d-bace-7093b6fc5971 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:50.893597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c6558225-2816-4a2d-bace-7093b6fc5971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:50.921561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:50.975119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1162/2304] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:50.988772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7f34-8a48-465a-a689-1ee4002d7266 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:50.989066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7f34-8a48-465a-a689-1ee4002d7266 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:50.989347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7f34-8a48-465a-a689-1ee4002d7266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.009812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8c8b7f34-8a48-465a-a689-1ee4002d7266 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:51.011062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8c8b7f34-8a48-465a-a689-1ee4002d7266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:51.021194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1143/2305] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:51.026954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6558225-2816-4a2d-bace-7093b6fc5971 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.038118 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6558225-2816-4a2d-bace-7093b6fc5971 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.043351 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.044091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.044466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.044815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.045529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:51.045908 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.047644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.060178 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1163/2306] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:51.065233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7f34-8a48-465a-a689-1ee4002d7266 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.074461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7f34-8a48-465a-a689-1ee4002d7266 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.079697 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.080365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.080657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.080928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.081561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.083797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.112692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1144/2307] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:51 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:51.117070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.127509 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a6cbb-be79-4b8b-bcf7-6ac34ad3e5d6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.193851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.194602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.194880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.195158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.195836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.197663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.222027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1164/2308] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:51 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:51.226461 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.237577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5cedc-5d46-4c32-ae96-71976f96a461 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.242887 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.243509 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.243790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.244065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.244717 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.246348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.257410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1145/2309] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:11:51.261441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.272709 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96d52d-e4ac-410b-a4a2-2834880f6d3a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.277346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ffc0a-c28a-4ff6-8008-a723aa7ece00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.277945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ffc0a-c28a-4ff6-8008-a723aa7ece00 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.278265 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ffc0a-c28a-4ff6-8008-a723aa7ece00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.278544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ffc0a-c28a-4ff6-8008-a723aa7ece00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.279174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ffc0a-c28a-4ff6-8008-a723aa7ece00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.280765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ffc0a-c28a-4ff6-8008-a723aa7ece00 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.294946 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1165/2310] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:51.299217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.310572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a048d-cfc3-410c-be39-910e9b6a183d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.319614 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.320334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.320616 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.320890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] PATH_INFO: `/v3/projects/237f6fe778a14fd5a4b4c1fd587556c9/users/18e058e7070144fda6b830271a217515/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.336730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237f6fe778a14fd5a4b4c1fd587556c9, user_id=18e058e7070144fda6b830271a217515, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.339412 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.353427 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1146/2311] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:51 2022] PUT /identity/v3/projects/237f6fe778a14fd5a4b4c1fd587556c9/users/18e058e7070144fda6b830271a217515/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:51.366744 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb4cc-644c-4239-8bf5-c28dff04478f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.367031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb4cc-644c-4239-8bf5-c28dff04478f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.367308 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb4cc-644c-4239-8bf5-c28dff04478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.396754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b97fb4cc-644c-4239-8bf5-c28dff04478f None None] MFA Rules not processed for user `18e058e7070144fda6b830271a217515`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:51.397985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b97fb4cc-644c-4239-8bf5-c28dff04478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:51.466492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1166/2312] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:51.478172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.479906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:51.542949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d45bc3-c27d-4ca1-bc1d-ae65bdfeb9c4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.546632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09cf89-3a16-46d0-b052-63bf7e46de6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.547233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09cf89-3a16-46d0-b052-63bf7e46de6e service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.547513 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09cf89-3a16-46d0-b052-63bf7e46de6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.547820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09cf89-3a16-46d0-b052-63bf7e46de6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.552960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:51.556760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09cf89-3a16-46d0-b052-63bf7e46de6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.558882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09cf89-3a16-46d0-b052-63bf7e46de6e service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.569934 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1147/2313] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:51.592188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb4cc-644c-4239-8bf5-c28dff04478f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.622347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:51.656499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb4cc-644c-4239-8bf5-c28dff04478f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.661675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.662327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.662614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.662890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] PATH_INFO: `/v3/users/18e058e7070144fda6b830271a217515` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.664017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e058e7070144fda6b830271a217515)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.665968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.711802 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e058e7070144fda6b830271a217515'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:51.724346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e058e7070144fda6b830271a217515'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:51.725030 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e058e7070144fda6b830271a217515'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:51.725649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e058e7070144fda6b830271a217515'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:51.732905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e058e7070144fda6b830271a217515'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:51.745002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1167/2314] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:51 2022] DELETE /identity/v3/users/18e058e7070144fda6b830271a217515 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:51.749676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.750180 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.750285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.770608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:51.771810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:51.828758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1148/2315] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:51.838966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:51.840349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:51.897689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52357-bd37-4270-b2cd-07e91b3ad9da admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:51.901413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513ac48-f907-4e4f-a2cb-602553128d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:51.902006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513ac48-f907-4e4f-a2cb-602553128d13 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:51.902366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513ac48-f907-4e4f-a2cb-602553128d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:51.902645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513ac48-f907-4e4f-a2cb-602553128d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:51.912414 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513ac48-f907-4e4f-a2cb-602553128d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:51.913841 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513ac48-f907-4e4f-a2cb-602553128d13 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:51.923438 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1168/2316] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:52.190981 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.192441 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:52.206143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb525a1-e7d3-4e33-ba9c-2051dcb48470 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.211730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.212306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.212585 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.212863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] PATH_INFO: `/v3/projects/237f6fe778a14fd5a4b4c1fd587556c9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.213992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=237f6fe778a14fd5a4b4c1fd587556c9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.215933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.262476 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237f6fe778a14fd5a4b4c1fd587556c9', 'request_id': 'req-840f2805-00e8-4493-8301-2b86fb0f1c2b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:52.269133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237f6fe778a14fd5a4b4c1fd587556c9', 'request_id': 'req-840f2805-00e8-4493-8301-2b86fb0f1c2b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:52.276631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237f6fe778a14fd5a4b4c1fd587556c9', 'request_id': 'req-840f2805-00e8-4493-8301-2b86fb0f1c2b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:52.287072 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] The token cache is being invalidate because project 237f6fe778a14fd5a4b4c1fd587556c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:52.287360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:52.287968 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-840f2805-00e8-4493-8301-2b86fb0f1c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:52.289426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1149/2317] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:52 2022] DELETE /identity/v3/projects/237f6fe778a14fd5a4b4c1fd587556c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:52.294389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff51be9-3fdf-4351-885f-ae1809a238e8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.294675 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff51be9-3fdf-4351-885f-ae1809a238e8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.294947 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff51be9-3fdf-4351-885f-ae1809a238e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.316203 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-eff51be9-3fdf-4351-885f-ae1809a238e8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:52.317386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eff51be9-3fdf-4351-885f-ae1809a238e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:52.363020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:52.380261 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1169/2318] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:52.387967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6e7c0-70ea-4701-85fc-330bbd2dc1f8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.388259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6e7c0-70ea-4701-85fc-330bbd2dc1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.388524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6e7c0-70ea-4701-85fc-330bbd2dc1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.408849 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f0a6e7c0-70ea-4701-85fc-330bbd2dc1f8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:52.410047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f0a6e7c0-70ea-4701-85fc-330bbd2dc1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:52.417879 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1150/2319] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:52.422015 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff51be9-3fdf-4351-885f-ae1809a238e8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.431581 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff51be9-3fdf-4351-885f-ae1809a238e8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.436416 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.437004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.437281 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.437551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.439012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:52.439012 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.440889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.452249 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1170/2320] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:52.457516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6e7c0-70ea-4701-85fc-330bbd2dc1f8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.466660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6e7c0-70ea-4701-85fc-330bbd2dc1f8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.471417 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.472007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.472287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.472561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.473201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.475126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.504937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1151/2321] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:52 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:11:52.508762 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.521466 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77b9d-1fe9-4187-b636-4a311d02803e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.582421 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.583055 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.583317 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.583655 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.584301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.586245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.614543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1171/2322] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:52 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:52.618796 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.631157 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367272f-29d8-4fd9-9241-346ddfa4c249 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.636594 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.637550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.637895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.638357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.639006 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.640705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.652785 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1152/2323] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:52.656955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.668225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60abc-3006-4a55-be6f-e48178a5b751 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.674242 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384566-d5f1-4c6f-b711-8d7c0d458534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.674848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384566-d5f1-4c6f-b711-8d7c0d458534 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.675351 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384566-d5f1-4c6f-b711-8d7c0d458534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.675632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384566-d5f1-4c6f-b711-8d7c0d458534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.676280 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384566-d5f1-4c6f-b711-8d7c0d458534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.677875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384566-d5f1-4c6f-b711-8d7c0d458534 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.690989 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1172/2324] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:52.695912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.707315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357373dc-74f6-412d-9131-110c2c4d9677 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.712148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.712794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.713070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.713341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] PATH_INFO: `/v3/projects/c1ae82cf05e34293b837c5c6636fbf55/users/1dc9ba119d0a4ff780c78a170609e24a/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.728514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ae82cf05e34293b837c5c6636fbf55, user_id=1dc9ba119d0a4ff780c78a170609e24a, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.731215 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.744207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1153/2325] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:52 2022] PUT /identity/v3/projects/c1ae82cf05e34293b837c5c6636fbf55/users/1dc9ba119d0a4ff780c78a170609e24a/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:52.755719 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eed49-bec1-44ee-9b36-6dd5417aecef None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.756003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eed49-bec1-44ee-9b36-6dd5417aecef None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.756278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eed49-bec1-44ee-9b36-6dd5417aecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.783985 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b33eed49-bec1-44ee-9b36-6dd5417aecef None None] MFA Rules not processed for user `1dc9ba119d0a4ff780c78a170609e24a`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:52.785090 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b33eed49-bec1-44ee-9b36-6dd5417aecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:52.849173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1173/2326] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:52.853706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.867905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:52.918383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcfcb9-5631-40fc-924c-8f4dcee9a588 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:52.923667 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:52.924406 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:52.924690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:52.924967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:52.925606 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:52.927543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:52.958364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1154/2327] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:52 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:52.959779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eed49-bec1-44ee-9b36-6dd5417aecef None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:52.970425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eed49-bec1-44ee-9b36-6dd5417aecef None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.012878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:53.029175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.029789 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.030069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.030375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.031020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.032949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.059075 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1174/2328] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:52 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:53.060546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.071927 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf647d-34ec-455c-8544-de8cd2738e41 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.076687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.077285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.077565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.077955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.078533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.080892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.091388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1155/2329] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:53.095606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.105854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366f18-84dc-4cbc-8081-e48850762aa6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.110520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664cd5c-be98-4d3d-a8b3-9ea4a5f9efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.111086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664cd5c-be98-4d3d-a8b3-9ea4a5f9efe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.111363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664cd5c-be98-4d3d-a8b3-9ea4a5f9efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.111638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664cd5c-be98-4d3d-a8b3-9ea4a5f9efe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.112283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664cd5c-be98-4d3d-a8b3-9ea4a5f9efe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.113879 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664cd5c-be98-4d3d-a8b3-9ea4a5f9efe1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.123877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1175/2330] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:53.129087 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.139550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728393-0b23-4d1d-a400-a386da910bf2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.147371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.148258 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.148704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.149155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] PATH_INFO: `/v3/projects/ddd33ce84d4a4514a0685804a9e3eef2/users/881cda9293b6490f9daba45e3dfde92b/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.166104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd33ce84d4a4514a0685804a9e3eef2, user_id=881cda9293b6490f9daba45e3dfde92b, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.173228 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.195550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1156/2331] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:53 2022] PUT /identity/v3/projects/ddd33ce84d4a4514a0685804a9e3eef2/users/881cda9293b6490f9daba45e3dfde92b/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:53.207861 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cfea-021e-4948-a6f1-b28a412a667c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.208156 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cfea-021e-4948-a6f1-b28a412a667c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.208748 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cfea-021e-4948-a6f1-b28a412a667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.239136 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6b85cfea-021e-4948-a6f1-b28a412a667c None None] MFA Rules not processed for user `881cda9293b6490f9daba45e3dfde92b`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:53.240413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6b85cfea-021e-4948-a6f1-b28a412a667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:53.326191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1176/2332] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:53.331201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.415276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3a12-56c7-454f-8e6b-43c869d52d64 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.420390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.421003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.421282 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.421563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.422382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.424833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.465298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1157/2333] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:53 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:53.466605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cfea-021e-4948-a6f1-b28a412a667c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.477475 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cfea-021e-4948-a6f1-b28a412a667c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.549507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.550147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.550431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.550705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.551490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.553838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.579482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1177/2334] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:53 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:53.584367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.599717 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15060201-0c93-4968-a0e8-1610714a48aa admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.612073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.613177 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.613467 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.613744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.614958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.616141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.634047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1158/2335] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:53.638002 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.650554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7489-95c3-460e-87e3-3e5487086a93 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.655842 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.656365 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.656649 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.657043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] PATH_INFO: `/v3/projects/9f57d737381440278cecab698c13cb02/users/295f013b24144cf6840d7c625f0e3a9a/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.674555 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f57d737381440278cecab698c13cb02, user_id=295f013b24144cf6840d7c625f0e3a9a, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.677247 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.695603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1178/2336] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:53 2022] PUT /identity/v3/projects/9f57d737381440278cecab698c13cb02/users/295f013b24144cf6840d7c625f0e3a9a/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:11:53.697475 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.714963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688b58a-ce53-46b2-92c3-63f394f04f1c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.769200 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:53.797535 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1ff22-2cff-4668-a0a3-805514196846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.798296 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ff22-2cff-4668-a0a3-805514196846 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.798582 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ff22-2cff-4668-a0a3-805514196846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.798858 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ff22-2cff-4668-a0a3-805514196846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.799516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1ff22-2cff-4668-a0a3-805514196846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.802242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1ff22-2cff-4668-a0a3-805514196846 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.814124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1159/2337] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:53.818665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.831132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a703152-18af-443c-ae8e-718e41d8c8e3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:53.835909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:53.836766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.837049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.837323 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] PATH_INFO: `/v3/projects/9f57d737381440278cecab698c13cb02/users/295f013b24144cf6840d7c625f0e3a9a/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.839292 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f57d737381440278cecab698c13cb02, user_id=295f013b24144cf6840d7c625f0e3a9a, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:53.841964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:53.852883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1179/2338] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:53 2022] PUT /identity/v3/projects/9f57d737381440278cecab698c13cb02/users/295f013b24144cf6840d7c625f0e3a9a/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:53.864848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:53.864848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:53.865526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:53.894960 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] MFA Rules not processed for user `295f013b24144cf6840d7c625f0e3a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:53.896266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:53.966055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1160/2339] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:53.977670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:53.979485 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:53.986602 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:54.039689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719deeb3-1e46-4c01-b707-39044937ca52 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:54.043441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ecd18-16ba-4676-bb17-50718ada0c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:54.044040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ecd18-16ba-4676-bb17-50718ada0c49 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:54.044322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ecd18-16ba-4676-bb17-50718ada0c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:54.044595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ecd18-16ba-4676-bb17-50718ada0c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:54.100153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ecd18-16ba-4676-bb17-50718ada0c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:54.101490 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ecd18-16ba-4676-bb17-50718ada0c49 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:54.110121 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1180/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:54.631212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:54.632615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:54.698191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24dd8-fc73-4622-a08d-05941592e226 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:54.702721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:54.703345 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:54.703642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:54.704416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] PATH_INFO: `/v3/users/f0b29ca8d370498da726077ed7a0a04b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:54.706067 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b29ca8d370498da726077ed7a0a04b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:54.708005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:54.753838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b29ca8d370498da726077ed7a0a04b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:54.760627 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b29ca8d370498da726077ed7a0a04b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:54.764143 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:54.769421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b29ca8d370498da726077ed7a0a04b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:54.770051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b29ca8d370498da726077ed7a0a04b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:54.783281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b29ca8d370498da726077ed7a0a04b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:54.789241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1161/2341] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:11:54 2022] DELETE /identity/v3/users/f0b29ca8d370498da726077ed7a0a04b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:54.793639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f1ad-b557-4bd8-bb32-052683a1a1f0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:54.793927 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f1ad-b557-4bd8-bb32-052683a1a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:54.794251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f1ad-b557-4bd8-bb32-052683a1a1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:54.813343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-02d5f1ad-b557-4bd8-bb32-052683a1a1f0 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:54.814576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-02d5f1ad-b557-4bd8-bb32-052683a1a1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:54.878400 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1181/2342] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:54.888472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:54.889987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:54.954671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dece015-9815-4e40-a9a4-78f7cd1a06c8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:54.958539 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:54.959169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:54.959450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:54.959727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:54.970606 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:54.972099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:54.982993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1162/2343] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:55.020967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cea2e6-fb4e-445a-9dfe-e70a81329d64 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.021552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cea2e6-fb4e-445a-9dfe-e70a81329d64 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.021552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cea2e6-fb4e-445a-9dfe-e70a81329d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.043061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-38cea2e6-fb4e-445a-9dfe-e70a81329d64 None None] MFA Rules not processed for user `8311284f41b34cb5a162fc850e73ad18`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:55.044355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-38cea2e6-fb4e-445a-9dfe-e70a81329d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:55.103745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1182/2344] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:55.269095 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.271326 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:55.292008 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa74af-0e03-408b-ad2e-e80312d914a6 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.296736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.297540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.297976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.298446 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] PATH_INFO: `/v3/projects/610bb05c924d4c6983c1bbdb78fa9e03` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.299888 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610bb05c924d4c6983c1bbdb78fa9e03)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.302257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.354030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610bb05c924d4c6983c1bbdb78fa9e03', 'request_id': 'req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:55.355404 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cea2e6-fb4e-445a-9dfe-e70a81329d64 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.361654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610bb05c924d4c6983c1bbdb78fa9e03', 'request_id': 'req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:55.362690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:55.367199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cea2e6-fb4e-445a-9dfe-e70a81329d64 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.370279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610bb05c924d4c6983c1bbdb78fa9e03', 'request_id': 'req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:55.381715 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] The token cache is being invalidate because project 610bb05c924d4c6983c1bbdb78fa9e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:11:55.382005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:55.382678 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9976913e-6be3-4179-9d8e-aa6d4dbd6c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:11:55.384198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1163/2345] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:11:55 2022] DELETE /identity/v3/projects/610bb05c924d4c6983c1bbdb78fa9e03 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:55.388910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0a90c-56d0-42d2-97be-1b9164ff1ac2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.389196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0a90c-56d0-42d2-97be-1b9164ff1ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.389472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0a90c-56d0-42d2-97be-1b9164ff1ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.411287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-abb0a90c-56d0-42d2-97be-1b9164ff1ac2 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:55.412504 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-abb0a90c-56d0-42d2-97be-1b9164ff1ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:55.422067 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e5278-e900-4348-b512-7ca360f8c34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.422981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e5278-e900-4348-b512-7ca360f8c34e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.423586 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e5278-e900-4348-b512-7ca360f8c34e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.423774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e5278-e900-4348-b512-7ca360f8c34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.425991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8f9e5278-e900-4348-b512-7ca360f8c34e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:55.436681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e5278-e900-4348-b512-7ca360f8c34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.438909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e5278-e900-4348-b512-7ca360f8c34e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.447875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1183/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:55.487634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1164/2347] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:11:55.495596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992188a-e41f-406d-bcfc-2d89bc1f3b31 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.495948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992188a-e41f-406d-bcfc-2d89bc1f3b31 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.496286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992188a-e41f-406d-bcfc-2d89bc1f3b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.518477 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b992188a-e41f-406d-bcfc-2d89bc1f3b31 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:55.519712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b992188a-e41f-406d-bcfc-2d89bc1f3b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:55.529900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1184/2348] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:55.534777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0a90c-56d0-42d2-97be-1b9164ff1ac2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.541516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:55.545811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0a90c-56d0-42d2-97be-1b9164ff1ac2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.555346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.556037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.556659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.557010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.557974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:11:55.558939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.560815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.579789 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1165/2349] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:11:55.580408 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992188a-e41f-406d-bcfc-2d89bc1f3b31 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.590410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992188a-e41f-406d-bcfc-2d89bc1f3b31 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.598915 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.603094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.603474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.603826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.604787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.611121 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.633138 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.634895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:55.648551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1185/2350] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:11:55 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:55.652379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.699162 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a4e6-c9ed-4a44-982d-405f86beacdc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.729047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3519-afd2-4c72-8a1d-65393c43a404 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.735027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.736185 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.736459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.736730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.737361 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.739483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.753384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.754205 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.754560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.754844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.756976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:55.769523 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1186/2351] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:11:55 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:11:55.770541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.796690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee806b-fabc-4a3a-9f1b-0308d79384fb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.823799 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.824428 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.824707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.824978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.825631 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.827254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.837257 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.839273 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.847453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1187/2352] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:55.850072 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.861174 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eea551-72d5-4dde-b7d1-35ea73bd11c9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.866349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b91136-99ec-496b-a7ba-8462931a3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.867608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b91136-99ec-496b-a7ba-8462931a3ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.868069 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b91136-99ec-496b-a7ba-8462931a3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.868590 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b91136-99ec-496b-a7ba-8462931a3ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.869623 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b91136-99ec-496b-a7ba-8462931a3ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.870127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1166/2353] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:11:55.872004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b91136-99ec-496b-a7ba-8462931a3ae0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.886208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1188/2354] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:11:55.889010 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:55.909409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148df2-9f08-4324-8e36-7e856e5a0fb1 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:55.919336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:55.920018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.920533 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.920659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] PATH_INFO: `/v3/projects/00e39d5df6fb4d728bcdba006b053031/users/2ab09a7fc6aa403dacc6c2662c87951b/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:55.958443 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e39d5df6fb4d728bcdba006b053031, user_id=2ab09a7fc6aa403dacc6c2662c87951b, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:55.961269 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:55.987601 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1167/2355] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:11:55 2022] PUT /identity/v3/projects/00e39d5df6fb4d728bcdba006b053031/users/2ab09a7fc6aa403dacc6c2662c87951b/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:11:55.998775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427bd9b-3c71-4953-bfba-0c31f98acb45 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:55.999214 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427bd9b-3c71-4953-bfba-0c31f98acb45 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:55.999826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427bd9b-3c71-4953-bfba-0c31f98acb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:56.048303 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7427bd9b-3c71-4953-bfba-0c31f98acb45 None None] MFA Rules not processed for user `2ab09a7fc6aa403dacc6c2662c87951b`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:11:56.050229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7427bd9b-3c71-4953-bfba-0c31f98acb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:56.103513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:56.170106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1189/2356] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:11:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:11:56.181053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:56.183514 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:56.249469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:11:56.280671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aaa54-0dbd-49ba-93e6-9ce23c2e2db6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:56.293471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:56.294481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:56.295048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:56.295630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:56.311710 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:56.315647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:56.326726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1168/2357] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:56.595177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427bd9b-3c71-4953-bfba-0c31f98acb45 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:56.605484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427bd9b-3c71-4953-bfba-0c31f98acb45 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:11:56.612332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:11:56.612951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:11:56.613351 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:11:56.613627 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:11:56.616086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:11:56.690750 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:11:56.692194 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:11:56.703268 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1190/2358] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:11:59.929884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:11:59.934918 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:00.054111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2d239-5036-4aae-a6ab-e8f43834226a service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:00.064692 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac965334-0e7b-4897-85f5-61b77e42ae17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:00.065279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965334-0e7b-4897-85f5-61b77e42ae17 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:00.065560 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965334-0e7b-4897-85f5-61b77e42ae17 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:00.065835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965334-0e7b-4897-85f5-61b77e42ae17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:00.067961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ac965334-0e7b-4897-85f5-61b77e42ae17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:00.082828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac965334-0e7b-4897-85f5-61b77e42ae17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:00.084874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac965334-0e7b-4897-85f5-61b77e42ae17 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:00.099469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1169/2359] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:11:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:00.885366 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:00.886870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:00.956524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26e10d-cda8-4aff-ae73-7c81b361e450 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:00.960928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b164d-a438-4236-a201-88411481373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:00.961542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b164d-a438-4236-a201-88411481373d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:00.961818 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b164d-a438-4236-a201-88411481373d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:00.962102 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b164d-a438-4236-a201-88411481373d admin admin] PATH_INFO: `/v3/users/1dc9ba119d0a4ff780c78a170609e24a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:00.963216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b164d-a438-4236-a201-88411481373d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc9ba119d0a4ff780c78a170609e24a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:00.965112 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b164d-a438-4236-a201-88411481373d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:01.018528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-115b164d-a438-4236-a201-88411481373d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc9ba119d0a4ff780c78a170609e24a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.030852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-115b164d-a438-4236-a201-88411481373d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc9ba119d0a4ff780c78a170609e24a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.033211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-115b164d-a438-4236-a201-88411481373d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc9ba119d0a4ff780c78a170609e24a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.034123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-115b164d-a438-4236-a201-88411481373d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc9ba119d0a4ff780c78a170609e24a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.043380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-115b164d-a438-4236-a201-88411481373d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc9ba119d0a4ff780c78a170609e24a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.045252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:01.063123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1191/2360] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:00 2022] DELETE /identity/v3/users/1dc9ba119d0a4ff780c78a170609e24a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:01.068686 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:01.069154 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:01.069611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:01.098367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:01.100365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:01.169773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1170/2361] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:01.180542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b164d-a438-4236-a201-88411481373d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:01.181956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-115b164d-a438-4236-a201-88411481373d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:01.248826 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b164d-a438-4236-a201-88411481373d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:01.253077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:01.253688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:01.254026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:01.254332 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:01.268341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:01.269959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:01.280885 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1192/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:01.577699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:01.580549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:01.615868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0bde2-2da4-469c-ae02-ee9e116f5236 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:01.621005 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:01.621721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:01.622103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:01.622468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] PATH_INFO: `/v3/projects/c1ae82cf05e34293b837c5c6636fbf55` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:01.623604 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ae82cf05e34293b837c5c6636fbf55)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:01.625505 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:01.673753 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ae82cf05e34293b837c5c6636fbf55', 'request_id': 'req-c08ca538-5969-4fc9-91f0-888788cab912'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.680028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ae82cf05e34293b837c5c6636fbf55', 'request_id': 'req-c08ca538-5969-4fc9-91f0-888788cab912'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.687580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ae82cf05e34293b837c5c6636fbf55', 'request_id': 'req-c08ca538-5969-4fc9-91f0-888788cab912'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.690112 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:01.704666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] The token cache is being invalidate because project c1ae82cf05e34293b837c5c6636fbf55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:01.705196 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.706276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.708839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1171/2363] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:01 2022] DELETE /identity/v3/projects/c1ae82cf05e34293b837c5c6636fbf55 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:01.712999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:01.722984 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605f1b-0749-4e68-890f-84d05af69a7a service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:01.779307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:01.779877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:01.780159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:01.780436 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] PATH_INFO: `/v3/users/881cda9293b6490f9daba45e3dfde92b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:01.781562 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881cda9293b6490f9daba45e3dfde92b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:01.783721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:01.836293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881cda9293b6490f9daba45e3dfde92b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.856109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881cda9293b6490f9daba45e3dfde92b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.856916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881cda9293b6490f9daba45e3dfde92b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.857613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881cda9293b6490f9daba45e3dfde92b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.869010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881cda9293b6490f9daba45e3dfde92b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:01.886699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1193/2364] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:01 2022] DELETE /identity/v3/users/881cda9293b6490f9daba45e3dfde92b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:02.165865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:02.167357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:02.182642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca538-5969-4fc9-91f0-888788cab912 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:02.243391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:02.244232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:02.244408 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:02.244714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] PATH_INFO: `/v3/users/2ab09a7fc6aa403dacc6c2662c87951b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:02.246364 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab09a7fc6aa403dacc6c2662c87951b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:02.248530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:02.280220 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:02.281787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:02.296646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d30e9-8783-46ff-b85e-e5c7c44db9b4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:02.300393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab09a7fc6aa403dacc6c2662c87951b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.302650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:02.303451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:02.303889 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:02.304373 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] PATH_INFO: `/v3/projects/ddd33ce84d4a4514a0685804a9e3eef2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:02.305666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd33ce84d4a4514a0685804a9e3eef2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:02.307736 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:02.308431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab09a7fc6aa403dacc6c2662c87951b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.315368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:02.317353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab09a7fc6aa403dacc6c2662c87951b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.317892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab09a7fc6aa403dacc6c2662c87951b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.332657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a3ff2fb6-204e-4087-85dd-fbca28e9fcd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab09a7fc6aa403dacc6c2662c87951b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.339165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1172/2365] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:02 2022] DELETE /identity/v3/users/2ab09a7fc6aa403dacc6c2662c87951b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:02.343553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:02.343864 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:02.344131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:02.362526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd33ce84d4a4514a0685804a9e3eef2', 'request_id': 'req-f0cd1b0e-82c6-4b25-a782-1d503174604e'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.364657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:02.365969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:02.369872 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd33ce84d4a4514a0685804a9e3eef2', 'request_id': 'req-f0cd1b0e-82c6-4b25-a782-1d503174604e'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.377721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd33ce84d4a4514a0685804a9e3eef2', 'request_id': 'req-f0cd1b0e-82c6-4b25-a782-1d503174604e'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.388864 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] The token cache is being invalidate because project ddd33ce84d4a4514a0685804a9e3eef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:02.389153 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.389774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.393221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1194/2366] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:02 2022] DELETE /identity/v3/projects/ddd33ce84d4a4514a0685804a9e3eef2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:12:02.397091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:02.398444 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:02.428346 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1173/2367] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:02.438771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:02.440379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:02.450930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:02.465882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd1b0e-82c6-4b25-a782-1d503174604e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:02.472110 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:02.472865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:02.473155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:02.473432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] PATH_INFO: `/v3/users/295f013b24144cf6840d7c625f0e3a9a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:02.474608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=295f013b24144cf6840d7c625f0e3a9a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:02.476529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:02.500409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f72d3-0741-4749-a8d5-e00eec6f17ac None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:02.508668 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:02.509469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:02.509905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:02.510264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:02.521522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:02.522973 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:02.527219 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295f013b24144cf6840d7c625f0e3a9a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.533362 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1174/2368] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:12:02.542724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295f013b24144cf6840d7c625f0e3a9a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.543398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295f013b24144cf6840d7c625f0e3a9a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.544021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295f013b24144cf6840d7c625f0e3a9a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.553320 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295f013b24144cf6840d7c625f0e3a9a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:02.568580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1195/2369] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:02 2022] DELETE /identity/v3/users/295f013b24144cf6840d7c625f0e3a9a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:12:02.924538 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:02.926056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:02.945399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50480-96eb-4f8c-8231-9f2f3179fcff service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:02.950680 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:02.952726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:02.974869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:03.019315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.021573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.022000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.022885 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] PATH_INFO: `/v3/projects/00e39d5df6fb4d728bcdba006b053031` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.024603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e39d5df6fb4d728bcdba006b053031)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.027865 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.032460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26db34-faea-4421-8b0d-994e7671f1de admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.037252 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.037970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.038379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.038706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] PATH_INFO: `/v3/projects/9f57d737381440278cecab698c13cb02` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.040163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f57d737381440278cecab698c13cb02)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.042278 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.099540 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f57d737381440278cecab698c13cb02', 'request_id': 'req-a4f117fd-b12a-4529-ada7-c379853b43c6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.100984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e39d5df6fb4d728bcdba006b053031', 'request_id': 'req-838298c0-d753-4f1c-9f74-b13ca118b6f7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.107340 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f57d737381440278cecab698c13cb02', 'request_id': 'req-a4f117fd-b12a-4529-ada7-c379853b43c6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.108344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e39d5df6fb4d728bcdba006b053031', 'request_id': 'req-838298c0-d753-4f1c-9f74-b13ca118b6f7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.123439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e39d5df6fb4d728bcdba006b053031', 'request_id': 'req-838298c0-d753-4f1c-9f74-b13ca118b6f7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.123730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f57d737381440278cecab698c13cb02', 'request_id': 'req-a4f117fd-b12a-4529-ada7-c379853b43c6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.140194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] The token cache is being invalidate because project 00e39d5df6fb4d728bcdba006b053031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:03.140637 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.141500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-838298c0-d753-4f1c-9f74-b13ca118b6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.143963 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1175/2370] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:02 2022] DELETE /identity/v3/projects/00e39d5df6fb4d728bcdba006b053031 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:03.149344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65151-9966-4aa6-b1cf-ea11e920ea6c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.149633 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65151-9966-4aa6-b1cf-ea11e920ea6c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.149910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65151-9966-4aa6-b1cf-ea11e920ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.152079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] The token cache is being invalidate because project 9f57d737381440278cecab698c13cb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:03.152382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.153078 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4f117fd-b12a-4529-ada7-c379853b43c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:03.154876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1196/2371] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:02 2022] DELETE /identity/v3/projects/9f57d737381440278cecab698c13cb02 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:03.163526 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc162a03-f475-477c-9254-f750362399ec None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.163657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc162a03-f475-477c-9254-f750362399ec None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.163995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc162a03-f475-477c-9254-f750362399ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.177251 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f9a65151-9966-4aa6-b1cf-ea11e920ea6c None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:03.178572 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9a65151-9966-4aa6-b1cf-ea11e920ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.192028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bc162a03-f475-477c-9254-f750362399ec None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:03.193524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bc162a03-f475-477c-9254-f750362399ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.241142 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:03.269696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1197/2372] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:03.270676 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc162a03-f475-477c-9254-f750362399ec None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.274303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1176/2373] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:03.275794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7ea7-8381-4e5f-beea-b63ad0089fe1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.276131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7ea7-8381-4e5f-beea-b63ad0089fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.276403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7ea7-8381-4e5f-beea-b63ad0089fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.284758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bc162a03-f475-477c-9254-f750362399ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.300863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2cfe7ea7-8381-4e5f-beea-b63ad0089fe1 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:03.302302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2cfe7ea7-8381-4e5f-beea-b63ad0089fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.311656 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1177/2374] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:03.316603 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe7ea7-8381-4e5f-beea-b63ad0089fe1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.327231 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe7ea7-8381-4e5f-beea-b63ad0089fe1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.333725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe24fa-a258-4f93-a1e5-4a89a4aace58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.334397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe24fa-a258-4f93-a1e5-4a89a4aace58 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.334681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe24fa-a258-4f93-a1e5-4a89a4aace58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.334958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe24fa-a258-4f93-a1e5-4a89a4aace58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.335617 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe24fa-a258-4f93-a1e5-4a89a4aace58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:12:03.336738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe24fa-a258-4f93-a1e5-4a89a4aace58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.338371 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe24fa-a258-4f93-a1e5-4a89a4aace58 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.350989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1178/2375] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:12:03.355500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:03.356248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cc0a1-5d1a-411b-835d-206ba3ff3317 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.356744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cc0a1-5d1a-411b-835d-206ba3ff3317 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.357209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cc0a1-5d1a-411b-835d-206ba3ff3317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.371512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc162a03-f475-477c-9254-f750362399ec None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.376273 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.376917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.377193 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.377465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.379245 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.380002 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8d7cc0a1-5d1a-411b-835d-206ba3ff3317 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:03.381186 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8d7cc0a1-5d1a-411b-835d-206ba3ff3317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.390305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1179/2376] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:03.391367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cc0a1-5d1a-411b-835d-206ba3ff3317 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.392272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.393598 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.402062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cc0a1-5d1a-411b-835d-206ba3ff3317 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.404458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1198/2377] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:03.405244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.406834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.407463 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.407810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.408016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.408652 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.410591 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.414451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7172-5faa-4a3a-80f4-65f360840775 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.419168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.419759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.420036 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.420304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.420950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:12:03.421254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.422912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.436870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1199/2378] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:12:03.442746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.445846 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1180/2379] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:03.450039 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.455098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206906f6-9029-4869-ba3f-e6bfda5b2150 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.515860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.517405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.517835 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.518128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.518770 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.520758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.521203 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294605e-0ec5-49ad-a30f-eb4c163d6066 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.526763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.527508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.527787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.528054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.529459 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.531524 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.553173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1200/2380] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:12:03.555769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1181/2381] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:03.557302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.559692 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.569182 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65749-e5fc-4944-8e5e-0952d652896a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.634030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.634811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.635198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.635580 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.636352 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.638458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.640884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8e106-b928-4a9a-b089-ca21ff15a0a3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.646449 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.647183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.647483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.647997 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.648724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.651381 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.663634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1201/2382] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:12:03.665759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1182/2383] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:03.667703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.669632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.679823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceedb8-1286-459d-a8cf-e76fa485f0a7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.680014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427d190-bf39-4966-bbfb-0ac76fa783f1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.684646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.685106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.685259 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.685518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.685795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.686132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.686472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.686584 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.687040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.687778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.689173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.690442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.700380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1183/2384] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:03.704691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1202/2385] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:12:03.705004 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.705978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.711704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:03.716149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52c69c-20fd-494a-90f2-00b5145acc72 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.716715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d221f-b11b-4611-95e7-9fba66f1b2d2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.722811 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.723445 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c97611-2b27-4993-aee1-7b71e2e73ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.723596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.723941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.724202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.724704 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c97611-2b27-4993-aee1-7b71e2e73ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.724871 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.726491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.726855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c97611-2b27-4993-aee1-7b71e2e73ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.727193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c97611-2b27-4993-aee1-7b71e2e73ad8 admin admin] PATH_INFO: `/v3/projects/8424b3c12264416789b5dccbe2d059bd/users/92587ece6ea34dbab5e3d39f925345b0/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.738114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1203/2386] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:12:03.742109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.748983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c97611-2b27-4993-aee1-7b71e2e73ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8424b3c12264416789b5dccbe2d059bd, user_id=92587ece6ea34dbab5e3d39f925345b0, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.752451 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c97611-2b27-4993-aee1-7b71e2e73ad8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.756805 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9962827-3f4f-440c-819c-9bd354a073f3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.763420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79815566-f539-44fb-b98c-0cf974a09118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.764141 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815566-f539-44fb-b98c-0cf974a09118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.764426 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815566-f539-44fb-b98c-0cf974a09118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.764820 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815566-f539-44fb-b98c-0cf974a09118 admin admin] PATH_INFO: `/v3/projects/411e605b2ba4437baa2a8b07ef841083/users/9a02de1dfece4fdaadf9f6e7d60d1b01/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.769807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1184/2387] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:03 2022] PUT /identity/v3/projects/8424b3c12264416789b5dccbe2d059bd/users/92587ece6ea34dbab5e3d39f925345b0/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:03.780000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.780440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.780813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.786800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79815566-f539-44fb-b98c-0cf974a09118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411e605b2ba4437baa2a8b07ef841083, user_id=9a02de1dfece4fdaadf9f6e7d60d1b01, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.789573 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79815566-f539-44fb-b98c-0cf974a09118 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.804362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1204/2388] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:03 2022] PUT /identity/v3/projects/411e605b2ba4437baa2a8b07ef841083/users/9a02de1dfece4fdaadf9f6e7d60d1b01/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:12:03.809307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.809621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.809895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.814055 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] MFA Rules not processed for user `92587ece6ea34dbab5e3d39f925345b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:03.814926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.832032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:03.834109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.839935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:03.888468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1185/2389] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:12:03.901647 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.903209 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.910109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1205/2390] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:03.919702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:03.921254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:03.970600 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9f508-d048-40b5-8f99-6dc069fe3dda None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.974827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d5913-c6dc-4abd-9a20-78273d5a0281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.975521 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d5913-c6dc-4abd-9a20-78273d5a0281 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.975807 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d5913-c6dc-4abd-9a20-78273d5a0281 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.976081 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d5913-c6dc-4abd-9a20-78273d5a0281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.985217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d5913-c6dc-4abd-9a20-78273d5a0281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:03.986683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d5913-c6dc-4abd-9a20-78273d5a0281 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:03.987418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e5d1-efca-4383-a020-b02690d0e47d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:03.991086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:03.991760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:03.992139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:03.992626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:03.996755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1186/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:12:04.004646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:04.006221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:04.016191 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1206/2392] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:12:05.164839 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e089-744e-45a6-8ce9-46f6b042106a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:05.165357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e089-744e-45a6-8ce9-46f6b042106a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:05.165466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e089-744e-45a6-8ce9-46f6b042106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:05.198037 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2179e089-744e-45a6-8ce9-46f6b042106a None None] MFA Rules not processed for user `9a02de1dfece4fdaadf9f6e7d60d1b01`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:05.199623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2179e089-744e-45a6-8ce9-46f6b042106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:05.277119 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:05.282016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1187/2393] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:05.293558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:05.304707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da270f8-f8b8-49f2-a8c6-dadca63c9b3d service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:05.308703 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24144-9e46-4ee7-89af-9655ae078970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:05.309499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24144-9e46-4ee7-89af-9655ae078970 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:05.309835 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24144-9e46-4ee7-89af-9655ae078970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:05.310212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24144-9e46-4ee7-89af-9655ae078970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:05.321636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24144-9e46-4ee7-89af-9655ae078970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:05.323343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24144-9e46-4ee7-89af-9655ae078970 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:05.335804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1207/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:12:05.481040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:05.481350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:05.481638 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:05.502726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] MFA Rules not processed for user `92587ece6ea34dbab5e3d39f925345b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:05.503962 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:05.515598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1188/2395] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:06.960696 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0e267-03e6-4b07-8d48-04a92b3d9502 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:06.961223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0e267-03e6-4b07-8d48-04a92b3d9502 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:06.961223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0e267-03e6-4b07-8d48-04a92b3d9502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:07.002418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ccc0e267-03e6-4b07-8d48-04a92b3d9502 None None] MFA Rules not processed for user `9a02de1dfece4fdaadf9f6e7d60d1b01`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:07.019059 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ccc0e267-03e6-4b07-8d48-04a92b3d9502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:07.050395 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1208/2396] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:08.126307 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:08.127910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:08.145940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb0650-1718-4369-ac28-74d83d94dc2e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:08.151683 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:08.152630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:08.153069 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:08.154283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] PATH_INFO: `/v3/users/5c7a939da3c34d418d768cb7bdf9920a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:08.156357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7a939da3c34d418d768cb7bdf9920a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:08.159745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:08.222290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7a939da3c34d418d768cb7bdf9920a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.231210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7a939da3c34d418d768cb7bdf9920a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.241124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7a939da3c34d418d768cb7bdf9920a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.242969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7a939da3c34d418d768cb7bdf9920a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.258159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-d1edb988-2d72-4174-9b7e-cc22e9c2cb8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7a939da3c34d418d768cb7bdf9920a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.264518 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1189/2397] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:08 2022] DELETE /identity/v3/users/5c7a939da3c34d418d768cb7bdf9920a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:08.483945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0e267-03e6-4b07-8d48-04a92b3d9502 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:08.503932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0e267-03e6-4b07-8d48-04a92b3d9502 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:08.573688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:08.574499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:08.574882 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:08.575396 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] PATH_INFO: `/v3/projects/d389e68b0e3d443c80ee4063758d51dc` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:08.576606 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d389e68b0e3d443c80ee4063758d51dc)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:08.579275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:08.626364 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:08.639817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd389e68b0e3d443c80ee4063758d51dc', 'request_id': 'req-0d629354-9b8a-44fb-9774-2c812e2584a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.647902 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd389e68b0e3d443c80ee4063758d51dc', 'request_id': 'req-0d629354-9b8a-44fb-9774-2c812e2584a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.656689 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd389e68b0e3d443c80ee4063758d51dc', 'request_id': 'req-0d629354-9b8a-44fb-9774-2c812e2584a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.668512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] The token cache is being invalidate because project d389e68b0e3d443c80ee4063758d51dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:08.668812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.669463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0d629354-9b8a-44fb-9774-2c812e2584a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:08.671399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1209/2398] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:08 2022] DELETE /identity/v3/projects/d389e68b0e3d443c80ee4063758d51dc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:12:08.676122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78996af-f288-42c4-a40b-6d367189201f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:08.676415 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78996af-f288-42c4-a40b-6d367189201f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:08.676695 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78996af-f288-42c4-a40b-6d367189201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:08.697277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a78996af-f288-42c4-a40b-6d367189201f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:08.698530 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a78996af-f288-42c4-a40b-6d367189201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:08.762548 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1190/2399] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:08.770558 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae287-b6b0-4eee-9692-b80cf94c3970 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:08.770850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae287-b6b0-4eee-9692-b80cf94c3970 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:08.771123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae287-b6b0-4eee-9692-b80cf94c3970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:08.791123 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-807ae287-b6b0-4eee-9692-b80cf94c3970 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:08.792399 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-807ae287-b6b0-4eee-9692-b80cf94c3970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:08.801614 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1210/2400] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:08.805890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78996af-f288-42c4-a40b-6d367189201f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:08.817353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78996af-f288-42c4-a40b-6d367189201f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:08.822418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:08.823102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:08.823388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:08.823657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:08.824421 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:12:08.824737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:08.826389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:08.838959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1191/2401] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:12:08.843463 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ae287-b6b0-4eee-9692-b80cf94c3970 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:08.853752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ae287-b6b0-4eee-9692-b80cf94c3970 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:08.858621 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:08.859223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:08.859501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:08.859768 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:08.860521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:08.862464 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:08.891876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1211/2402] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:08 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:08.896165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:08.906033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad54a1b-2cc1-4f83-9459-8b51bbbdd9af admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:08.961279 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:08.973611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:08.974348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:08.974694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:08.975030 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:08.975745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:08.977748 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:09.002822 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1192/2403] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:08 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:09.006774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:09.019925 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ddda-b6ba-4f2b-a330-08d5235f6d75 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:09.025443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:09.026594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:09.026967 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:09.027307 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:09.028019 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:09.030781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:09.048197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1212/2404] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:12:09.052276 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:09.062060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4336c-b141-4cc3-9cf8-44b048dcec71 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:09.068660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcfeb5-7ed3-4383-aa37-46dcb4a80acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:09.069492 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfeb5-7ed3-4383-aa37-46dcb4a80acb admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:09.069946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfeb5-7ed3-4383-aa37-46dcb4a80acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:09.070319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfeb5-7ed3-4383-aa37-46dcb4a80acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:09.071099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcfeb5-7ed3-4383-aa37-46dcb4a80acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:09.073305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcfeb5-7ed3-4383-aa37-46dcb4a80acb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:09.087527 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1193/2405] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:09.088636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:09.098741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e5474-16cb-4c7b-8a47-b2757f393b70 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:09.103350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:09.104640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:09.105074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:09.105384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] PATH_INFO: `/v3/projects/fa369e92b7b34d3d8bdf5dc258ee2a16/users/5ee3036a470441e09d3a0114d25c6511/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:09.122582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa369e92b7b34d3d8bdf5dc258ee2a16, user_id=5ee3036a470441e09d3a0114d25c6511, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:09.126223 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:09.144080 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1213/2406] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:09 2022] PUT /identity/v3/projects/fa369e92b7b34d3d8bdf5dc258ee2a16/users/5ee3036a470441e09d3a0114d25c6511/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:09.154764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde882e3-9c56-469d-b732-4500957b6e6a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:09.155284 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde882e3-9c56-469d-b732-4500957b6e6a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:09.155768 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde882e3-9c56-469d-b732-4500957b6e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:09.187312 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fde882e3-9c56-469d-b732-4500957b6e6a None None] MFA Rules not processed for user `5ee3036a470441e09d3a0114d25c6511`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:09.189473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fde882e3-9c56-469d-b732-4500957b6e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:09.282134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1194/2407] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:09.292039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:09.294774 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:09.431163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df72e-8644-417a-9b2c-05451eaa0c03 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:09.440177 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:09.441430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:09.441710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:09.441973 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:09.455702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:09.457306 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:09.468612 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1214/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:13.450744 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b2fc-a45e-4fe8-b19a-0463284f14c8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:13.451250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b2fc-a45e-4fe8-b19a-0463284f14c8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:13.451498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b2fc-a45e-4fe8-b19a-0463284f14c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:13.472458 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8a07b2fc-a45e-4fe8-b19a-0463284f14c8 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:13.473669 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8a07b2fc-a45e-4fe8-b19a-0463284f14c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:13.529138 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1195/2409] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:13.543058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:13.544453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:13.591603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:13.621246 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e97ec-1775-4017-86f2-d1ec68d157a9 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:13.626800 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb980945-aece-49c2-9761-3e4af3e911b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:13.627442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb980945-aece-49c2-9761-3e4af3e911b3 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:13.627722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb980945-aece-49c2-9761-3e4af3e911b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:13.627996 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb980945-aece-49c2-9761-3e4af3e911b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:13.636479 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb980945-aece-49c2-9761-3e4af3e911b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:13.638056 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb980945-aece-49c2-9761-3e4af3e911b3 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:13.647423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1215/2410] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:15.475287 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b2fc-a45e-4fe8-b19a-0463284f14c8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:15.564134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b2fc-a45e-4fe8-b19a-0463284f14c8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:15.569999 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:15.570770 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:15.571122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:15.571466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] PATH_INFO: `/v3/users/5ee3036a470441e09d3a0114d25c6511` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:15.572698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee3036a470441e09d3a0114d25c6511)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:15.574726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:15.586810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:15.637178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee3036a470441e09d3a0114d25c6511'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:15.646439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee3036a470441e09d3a0114d25c6511'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:15.655852 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee3036a470441e09d3a0114d25c6511'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:15.657104 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee3036a470441e09d3a0114d25c6511'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:15.671626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee3036a470441e09d3a0114d25c6511'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:15.678103 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1196/2411] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:15 2022] DELETE /identity/v3/users/5ee3036a470441e09d3a0114d25c6511 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:15.682688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:15.683563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:15.683844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:15.706147 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:15.707386 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:15.803236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1216/2412] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:12:15.811802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:15.814847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:15.888374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5fca-97a4-4878-928f-d8009866a5b2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:15.893127 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d703db3-863f-48bf-b2f3-146957945bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:15.893735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703db3-863f-48bf-b2f3-146957945bdb service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:15.894014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703db3-863f-48bf-b2f3-146957945bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:15.894313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d703db3-863f-48bf-b2f3-146957945bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:15.903670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d703db3-863f-48bf-b2f3-146957945bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:15.905220 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d703db3-863f-48bf-b2f3-146957945bdb service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:15.915926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1197/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:12:16.225726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:16.227474 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:16.244221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539de47-f333-45d3-9bbb-66bc678424f8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:16.248941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:16.249570 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.249853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.250170 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] PATH_INFO: `/v3/projects/fa369e92b7b34d3d8bdf5dc258ee2a16` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.251722 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa369e92b7b34d3d8bdf5dc258ee2a16)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:16.253639 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:16.322534 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa369e92b7b34d3d8bdf5dc258ee2a16', 'request_id': 'req-1aecc495-6ba8-4020-b4a3-0424fafcfbad'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:16.329896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa369e92b7b34d3d8bdf5dc258ee2a16', 'request_id': 'req-1aecc495-6ba8-4020-b4a3-0424fafcfbad'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:16.340218 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa369e92b7b34d3d8bdf5dc258ee2a16', 'request_id': 'req-1aecc495-6ba8-4020-b4a3-0424fafcfbad'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:16.354839 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] The token cache is being invalidate because project fa369e92b7b34d3d8bdf5dc258ee2a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:16.355184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:16.355884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1aecc495-6ba8-4020-b4a3-0424fafcfbad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:16.362152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1217/2414] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:16 2022] DELETE /identity/v3/projects/fa369e92b7b34d3d8bdf5dc258ee2a16 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:12:16.364032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c864a-9fd2-4119-8839-fd1109a0c047 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.364466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c864a-9fd2-4119-8839-fd1109a0c047 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.364906 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c864a-9fd2-4119-8839-fd1109a0c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.398938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bb9c864a-9fd2-4119-8839-fd1109a0c047 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:16.400506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bb9c864a-9fd2-4119-8839-fd1109a0c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:16.490854 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1198/2415] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:16.499992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a440b-6ae5-407a-b3bf-bc98f70dee10 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.501186 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a440b-6ae5-407a-b3bf-bc98f70dee10 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.501468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a440b-6ae5-407a-b3bf-bc98f70dee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.527063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-821a440b-6ae5-407a-b3bf-bc98f70dee10 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:16.528492 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-821a440b-6ae5-407a-b3bf-bc98f70dee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:16.543154 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1218/2416] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:16.546956 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c864a-9fd2-4119-8839-fd1109a0c047 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:16.560751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c864a-9fd2-4119-8839-fd1109a0c047 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:16.574117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:16.574390 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.574758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.575198 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.576075 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:12:16.576434 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:16.578343 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:16.597549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1199/2417] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:12:16.598860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a440b-6ae5-407a-b3bf-bc98f70dee10 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:16.611195 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a440b-6ae5-407a-b3bf-bc98f70dee10 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:16.623468 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:16.624111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.624389 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.624657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.625636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:16.628042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:16.709491 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1219/2418] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:16 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:16.711490 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:16.746605 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae159800-0cea-4177-bf61-07bc1e6fbad6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:16.765558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:16.823224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:16.823929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.824280 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.824621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.825324 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:16.827501 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:16.881655 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1200/2419] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:16 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:16.883405 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:16.898292 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683646-8d76-4037-89cf-e153c9a22859 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:16.904085 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:16.904702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.904978 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.905397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.906035 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:16.908806 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:16.922134 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1220/2420] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:16.926983 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:16.939659 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2bd32-abf8-4249-9c64-daaf4786ef0b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:16.945904 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c565192-2439-4497-b6ad-133e996a54b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:16.946623 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c565192-2439-4497-b6ad-133e996a54b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:16.946915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c565192-2439-4497-b6ad-133e996a54b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:16.947624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c565192-2439-4497-b6ad-133e996a54b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:16.947945 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c565192-2439-4497-b6ad-133e996a54b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:16.949674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c565192-2439-4497-b6ad-133e996a54b8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:16.984534 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1201/2421] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:16.986155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:16.996937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a4f1a-a787-4d29-8c2c-283692a87da2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:17.006255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:17.007418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:17.008091 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:17.008495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] PATH_INFO: `/v3/projects/a6827cec12904980ac2d1228dd2302dc/users/52046dac791f489da355a622f6db3fcd/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:17.033226 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6827cec12904980ac2d1228dd2302dc, user_id=52046dac791f489da355a622f6db3fcd, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:17.035941 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:17.038435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:17.054380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1221/2422] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:16 2022] PUT /identity/v3/projects/a6827cec12904980ac2d1228dd2302dc/users/52046dac791f489da355a622f6db3fcd/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:17.065306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c76fd-d1f6-4616-8e01-232598212785 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:17.065631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c76fd-d1f6-4616-8e01-232598212785 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:17.065914 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c76fd-d1f6-4616-8e01-232598212785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:17.099828 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6f7c76fd-d1f6-4616-8e01-232598212785 None None] MFA Rules not processed for user `52046dac791f489da355a622f6db3fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:17.101050 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6f7c76fd-d1f6-4616-8e01-232598212785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:17.183991 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1202/2423] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:17.197687 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:17.199735 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:17.307814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b1975-5559-4e4b-846c-cc538675dcf1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:17.311942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61ac84-8fc8-4e0d-be49-e2efaf4aabde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:17.312619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61ac84-8fc8-4e0d-be49-e2efaf4aabde service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:17.312940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61ac84-8fc8-4e0d-be49-e2efaf4aabde service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:17.314700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61ac84-8fc8-4e0d-be49-e2efaf4aabde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:17.325325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61ac84-8fc8-4e0d-be49-e2efaf4aabde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:17.326936 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61ac84-8fc8-4e0d-be49-e2efaf4aabde service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:17.337608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1222/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:26.515193 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c76fd-d1f6-4616-8e01-232598212785 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:26.585272 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c76fd-d1f6-4616-8e01-232598212785 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:26.591884 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:26.593462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:26.595027 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:26.595317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] PATH_INFO: `/v3/users/52046dac791f489da355a622f6db3fcd` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:26.597366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52046dac791f489da355a622f6db3fcd)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:26.604937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:26.654389 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:26.677223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52046dac791f489da355a622f6db3fcd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:26.687751 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52046dac791f489da355a622f6db3fcd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:26.701304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52046dac791f489da355a622f6db3fcd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:26.702230 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52046dac791f489da355a622f6db3fcd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:26.717295 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52046dac791f489da355a622f6db3fcd'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:26.726214 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1203/2425] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:26 2022] DELETE /identity/v3/users/52046dac791f489da355a622f6db3fcd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:26.732432 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df804d3f-8b88-4105-b7df-496578562cec None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:26.733009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df804d3f-8b88-4105-b7df-496578562cec None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:26.733009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df804d3f-8b88-4105-b7df-496578562cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:26.762788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-df804d3f-8b88-4105-b7df-496578562cec None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:26.764071 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-df804d3f-8b88-4105-b7df-496578562cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:26.834644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1223/2426] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:26.845161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:26.846814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:26.918731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e557a-7dbe-4fd0-bea3-25770c1c4095 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:26.922912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa63ca-3452-4b78-9e35-8ad617fa12e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:26.923536 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa63ca-3452-4b78-9e35-8ad617fa12e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:26.923835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa63ca-3452-4b78-9e35-8ad617fa12e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:26.924123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa63ca-3452-4b78-9e35-8ad617fa12e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:26.935375 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa63ca-3452-4b78-9e35-8ad617fa12e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:26.936869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa63ca-3452-4b78-9e35-8ad617fa12e0 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:26.948907 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1204/2427] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:27.269166 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df804d3f-8b88-4105-b7df-496578562cec None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:27.270912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-df804d3f-8b88-4105-b7df-496578562cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:27.294142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df804d3f-8b88-4105-b7df-496578562cec None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:27.303263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:27.304003 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.304450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.304733 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] PATH_INFO: `/v3/projects/a6827cec12904980ac2d1228dd2302dc` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.306325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6827cec12904980ac2d1228dd2302dc)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:27.309073 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:27.375105 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6827cec12904980ac2d1228dd2302dc', 'request_id': 'req-955c19ed-3ae3-4075-b480-11cffe3cd9e3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:27.382634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6827cec12904980ac2d1228dd2302dc', 'request_id': 'req-955c19ed-3ae3-4075-b480-11cffe3cd9e3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:27.392513 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6827cec12904980ac2d1228dd2302dc', 'request_id': 'req-955c19ed-3ae3-4075-b480-11cffe3cd9e3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:27.408854 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] The token cache is being invalidate because project a6827cec12904980ac2d1228dd2302dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:27.409182 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:27.410017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-955c19ed-3ae3-4075-b480-11cffe3cd9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:27.415300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1224/2428] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:27 2022] DELETE /identity/v3/projects/a6827cec12904980ac2d1228dd2302dc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:27.417250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bcfa4-c282-40e8-bdef-b3d880c616d8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.417708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bcfa4-c282-40e8-bdef-b3d880c616d8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.418000 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bcfa4-c282-40e8-bdef-b3d880c616d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.442976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b75bcfa4-c282-40e8-bdef-b3d880c616d8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:27.444357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b75bcfa4-c282-40e8-bdef-b3d880c616d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:27.511438 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1205/2429] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:27.519817 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24326-4c09-4ecf-81f6-05284fead955 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.520106 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24326-4c09-4ecf-81f6-05284fead955 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.520383 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb24326-4c09-4ecf-81f6-05284fead955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.542208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fdb24326-4c09-4ecf-81f6-05284fead955 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:27.543417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fdb24326-4c09-4ecf-81f6-05284fead955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:27.551919 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1225/2430] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:27.556399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bcfa4-c282-40e8-bdef-b3d880c616d8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:27.568101 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bcfa4-c282-40e8-bdef-b3d880c616d8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:27.573315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:27.574141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.574428 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.574759 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.575420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:12:27.575714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:27.577285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:27.593723 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1206/2431] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 20:12:27.595338 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24326-4c09-4ecf-81f6-05284fead955 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:27.604929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb24326-4c09-4ecf-81f6-05284fead955 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:27.610595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:27.611379 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.611808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.612251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.613045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:27.615909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:27.629074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:27.653388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1226/2432] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:27 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:27.654814 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:27.671507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d684e0-e184-4b6c-b4fb-eaa493c61ade admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:27.716020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:27.751126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:27.751910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.752181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.752497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.753240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:27.755237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:27.784391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1207/2433] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:27 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:27.790951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:27.806664 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56a242-165e-4227-a947-54d53a6599f8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:27.811758 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:27.812471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.813745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.814109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.814830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:27.816601 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:27.830497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1227/2434] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:27.832302 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:27.846913 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc81f-f028-4ca3-8096-5262e37c3683 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:27.853294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151535f-dc98-40f5-ad60-21633508b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:27.854140 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151535f-dc98-40f5-ad60-21633508b3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.854398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151535f-dc98-40f5-ad60-21633508b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.854680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151535f-dc98-40f5-ad60-21633508b3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.855358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151535f-dc98-40f5-ad60-21633508b3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:27.857034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151535f-dc98-40f5-ad60-21633508b3c4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:27.872333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1208/2435] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:27.879647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:27.892610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522ad01-02e7-4e98-8247-9b2ffef25947 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:27.897647 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:27.898394 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.898831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.899163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] PATH_INFO: `/v3/projects/c48aebc89dc54e09b940c58b1e4b59ca/users/f1a6727d32c44dbfbd5b693c72afedd5/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.917981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48aebc89dc54e09b940c58b1e4b59ca, user_id=f1a6727d32c44dbfbd5b693c72afedd5, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:27.921519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:27.941909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1228/2436] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:27 2022] PUT /identity/v3/projects/c48aebc89dc54e09b940c58b1e4b59ca/users/f1a6727d32c44dbfbd5b693c72afedd5/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:27.952628 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c63b1-cd83-4037-b293-2d0d8f3b5ae3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:27.953031 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c63b1-cd83-4037-b293-2d0d8f3b5ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:27.953201 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c63b1-cd83-4037-b293-2d0d8f3b5ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:27.986795 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5f2c63b1-cd83-4037-b293-2d0d8f3b5ae3 None None] MFA Rules not processed for user `f1a6727d32c44dbfbd5b693c72afedd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:27.987951 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5f2c63b1-cd83-4037-b293-2d0d8f3b5ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:28.075381 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1209/2437] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:28.079717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:28.155580 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6415f-cf1d-43c9-ab17-c8e24d1f8ad3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:28.165487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:28.166322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.166804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.167240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.168093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:28.170521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:28.206497 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1229/2438] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:28 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:12:28.210809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c63b1-cd83-4037-b293-2d0d8f3b5ae3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:28.225342 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c63b1-cd83-4037-b293-2d0d8f3b5ae3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:28.299878 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:28.300857 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.301243 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.301589 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.302810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:28.304911 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:28.336698 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1210/2439] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:28 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:12:28.342159 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:28.358008 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d38051-af34-4cbe-b0b4-3d3b31d7baf6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:28.365918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:28.369700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.369700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.369700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.370605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:28.372263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:28.387058 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1230/2440] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:28.392482 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:28.403831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebc488-ae4c-40fe-8567-07bc31a6801b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:28.410052 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:28.410831 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.411185 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.411500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] PATH_INFO: `/v3/projects/4060c0c7b3604f068c47802b0e8fd9ad/users/e6bf4625509640c0855bc4e9af187528/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.435275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4060c0c7b3604f068c47802b0e8fd9ad, user_id=e6bf4625509640c0855bc4e9af187528, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:28.439721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:28.458648 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1211/2441] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:28 2022] PUT /identity/v3/projects/4060c0c7b3604f068c47802b0e8fd9ad/users/e6bf4625509640c0855bc4e9af187528/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:28.463417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:28.475505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f16d8-743c-43ef-8d8d-00063a4946d2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:28.550017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d36548-0455-4d8f-a010-8c484ee2adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:28.550747 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36548-0455-4d8f-a010-8c484ee2adfe admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.551031 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36548-0455-4d8f-a010-8c484ee2adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.551657 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36548-0455-4d8f-a010-8c484ee2adfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.552093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d36548-0455-4d8f-a010-8c484ee2adfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:28.554005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d36548-0455-4d8f-a010-8c484ee2adfe admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:28.570051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1231/2442] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:28.574829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:28.586869 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d4760-2a1c-454c-bc2c-6af5f61c821f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:28.591491 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:28.592134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.592416 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.592684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] PATH_INFO: `/v3/projects/4060c0c7b3604f068c47802b0e8fd9ad/users/e6bf4625509640c0855bc4e9af187528/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.597426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4060c0c7b3604f068c47802b0e8fd9ad, user_id=e6bf4625509640c0855bc4e9af187528, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:28.606837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:28.606837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:28.630454 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1212/2443] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:28 2022] PUT /identity/v3/projects/4060c0c7b3604f068c47802b0e8fd9ad/users/e6bf4625509640c0855bc4e9af187528/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:28.635564 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf417-797c-4b4d-8767-3c9b00452225 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.635888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf417-797c-4b4d-8767-3c9b00452225 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.636135 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf417-797c-4b4d-8767-3c9b00452225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.676473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3baaf417-797c-4b4d-8767-3c9b00452225 None None] MFA Rules not processed for user `e6bf4625509640c0855bc4e9af187528`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:28.677932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3baaf417-797c-4b4d-8767-3c9b00452225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:28.696229 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:28.778481 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1232/2444] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:28.793933 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:28.796190 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:28.872930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529870-d5f2-4e17-a8bf-7df8c211c042 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:28.882738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364e1fd-8247-4901-bafa-ae368afa494a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:28.883493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364e1fd-8247-4901-bafa-ae368afa494a service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:28.884056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364e1fd-8247-4901-bafa-ae368afa494a service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:28.884341 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364e1fd-8247-4901-bafa-ae368afa494a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:28.896680 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364e1fd-8247-4901-bafa-ae368afa494a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:28.898316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364e1fd-8247-4901-bafa-ae368afa494a service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:28.908993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1213/2445] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:29.371688 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf417-797c-4b4d-8767-3c9b00452225 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:29.444079 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf417-797c-4b4d-8767-3c9b00452225 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:29.449363 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:29.450173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:29.450531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:29.450979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] PATH_INFO: `/v3/users/f1a6727d32c44dbfbd5b693c72afedd5` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:29.452129 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a6727d32c44dbfbd5b693c72afedd5)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:29.454439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:29.512362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a6727d32c44dbfbd5b693c72afedd5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:29.530298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a6727d32c44dbfbd5b693c72afedd5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:29.531045 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a6727d32c44dbfbd5b693c72afedd5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:29.532327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a6727d32c44dbfbd5b693c72afedd5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:29.540778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a6727d32c44dbfbd5b693c72afedd5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:29.554847 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1233/2446] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:29 2022] DELETE /identity/v3/users/f1a6727d32c44dbfbd5b693c72afedd5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:29.559306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:29.559895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:29.559895 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:29.583576 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:29.584790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:29.671821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1214/2447] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:12:29.683549 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:29.685023 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:29.730551 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:29.759544 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7f22-1234-4471-b1cc-25d02612922f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:29.763929 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:29.764843 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:29.764962 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:29.765202 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:29.778496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:29.779988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:29.809812 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1234/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:12:30.137283 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:30.138773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:30.154102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0927156-2e0a-44cd-aa4c-60496abde62b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:30.164179 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:30.164946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:30.165237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:30.165515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] PATH_INFO: `/v3/projects/c48aebc89dc54e09b940c58b1e4b59ca` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:30.166724 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48aebc89dc54e09b940c58b1e4b59ca)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:30.168706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:30.228959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48aebc89dc54e09b940c58b1e4b59ca', 'request_id': 'req-7f272f42-39d4-424d-a992-fb2890351b40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.237626 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48aebc89dc54e09b940c58b1e4b59ca', 'request_id': 'req-7f272f42-39d4-424d-a992-fb2890351b40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.247450 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48aebc89dc54e09b940c58b1e4b59ca', 'request_id': 'req-7f272f42-39d4-424d-a992-fb2890351b40'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.262226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] The token cache is being invalidate because project c48aebc89dc54e09b940c58b1e4b59ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:30.262643 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.263442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.265327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1215/2449] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:30 2022] DELETE /identity/v3/projects/c48aebc89dc54e09b940c58b1e4b59ca => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:30.270375 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:30.284668 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418e51-d0cc-456e-9da2-b047f6a0195b service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:30.350042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:30.351006 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:30.352850 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:30.353335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] PATH_INFO: `/v3/users/e6bf4625509640c0855bc4e9af187528` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:30.354652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6bf4625509640c0855bc4e9af187528)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:30.356626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:30.416459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6bf4625509640c0855bc4e9af187528'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.430911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6bf4625509640c0855bc4e9af187528'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.431715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6bf4625509640c0855bc4e9af187528'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.432368 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6bf4625509640c0855bc4e9af187528'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.441849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-71122ea2-c2b1-4426-8599-c98f1d9be810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6bf4625509640c0855bc4e9af187528'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.455776 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1235/2450] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:30 2022] DELETE /identity/v3/users/e6bf4625509640c0855bc4e9af187528 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:30.791892 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:30.794003 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:30.825995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f272f42-39d4-424d-a992-fb2890351b40 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:30.850850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:30.921920 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:30.923512 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:30.923714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:30.924178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] PATH_INFO: `/v3/projects/4060c0c7b3604f068c47802b0e8fd9ad` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:30.925292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4060c0c7b3604f068c47802b0e8fd9ad)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:30.927466 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:30.987773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4060c0c7b3604f068c47802b0e8fd9ad', 'request_id': 'req-cb2d56c0-f125-40b5-b657-2ab620a2065a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:30.993905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4060c0c7b3604f068c47802b0e8fd9ad', 'request_id': 'req-cb2d56c0-f125-40b5-b657-2ab620a2065a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:31.002893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4060c0c7b3604f068c47802b0e8fd9ad', 'request_id': 'req-cb2d56c0-f125-40b5-b657-2ab620a2065a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:31.014334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] The token cache is being invalidate because project 4060c0c7b3604f068c47802b0e8fd9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:31.014488 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:31.015129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cb2d56c0-f125-40b5-b657-2ab620a2065a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:31.017418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1216/2451] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:30 2022] DELETE /identity/v3/projects/4060c0c7b3604f068c47802b0e8fd9ad => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:12:31.023236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea879c1-baa1-4a42-aa26-5eb1c96eda93 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.023529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea879c1-baa1-4a42-aa26-5eb1c96eda93 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.023813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea879c1-baa1-4a42-aa26-5eb1c96eda93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.049319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2ea879c1-baa1-4a42-aa26-5eb1c96eda93 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:31.050831 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2ea879c1-baa1-4a42-aa26-5eb1c96eda93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:31.112721 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:31.129815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1236/2452] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:31.139727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6829-0c8c-4cf7-b2d3-46573b34834e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.140014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6829-0c8c-4cf7-b2d3-46573b34834e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.140309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd6829-0c8c-4cf7-b2d3-46573b34834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.163725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d3fd6829-0c8c-4cf7-b2d3-46573b34834e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:31.165034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d3fd6829-0c8c-4cf7-b2d3-46573b34834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:31.173905 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1217/2453] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:31.178034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea879c1-baa1-4a42-aa26-5eb1c96eda93 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:31.189878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea879c1-baa1-4a42-aa26-5eb1c96eda93 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:31.194634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:31.195236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.195512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.195778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.196420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:12:31.196717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:31.198318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:31.212248 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1237/2454] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:12:31.216303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd6829-0c8c-4cf7-b2d3-46573b34834e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:31.226480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd6829-0c8c-4cf7-b2d3-46573b34834e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:31.231208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:31.231824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.232099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.232405 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.232987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:31.235107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:31.268874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1218/2455] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:31 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:31.272653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:31.284471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29758083-7b61-4bdc-96a7-6925ff3c53ee admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:31.351255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:31.352370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.353282 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.353775 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.354844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:31.358225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:31.388950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1238/2456] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:31 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:31.395522 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:31.411629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4921d9-a890-4fb1-ab74-ef353a55dc99 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:31.417218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:31.418133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.418301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.418546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.419109 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:31.421141 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:31.436339 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1219/2457] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:12:31.437448 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:31.452781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598928b-9445-4e81-9713-314e5ab8f2c2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:31.462108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cae94-4c49-4b05-b012-560cdf29ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:31.462728 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cae94-4c49-4b05-b012-560cdf29ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.463000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cae94-4c49-4b05-b012-560cdf29ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.463371 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cae94-4c49-4b05-b012-560cdf29ad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.463911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cae94-4c49-4b05-b012-560cdf29ad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:31.465505 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cae94-4c49-4b05-b012-560cdf29ad2b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:31.478666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1239/2458] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:31.482845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:31.496733 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3a3b-d0d2-4ca7-b0bb-0c31a8e7bf02 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:31.503221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:31.503890 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.504169 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.504442 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] PATH_INFO: `/v3/projects/2da5cc9f84494ff0a56c60dcff583cae/users/46a80c877b094c489f092fd467b229fe/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.521737 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da5cc9f84494ff0a56c60dcff583cae, user_id=46a80c877b094c489f092fd467b229fe, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:31.524550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:31.538685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1220/2459] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:31 2022] PUT /identity/v3/projects/2da5cc9f84494ff0a56c60dcff583cae/users/46a80c877b094c489f092fd467b229fe/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:31.544033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5ceb-238e-4934-b917-319681eb0a9f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.544357 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5ceb-238e-4934-b917-319681eb0a9f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.544636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5ceb-238e-4934-b917-319681eb0a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.567542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-58ad5ceb-238e-4934-b917-319681eb0a9f None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:31.569270 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-58ad5ceb-238e-4934-b917-319681eb0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:31.655441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1240/2460] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:31.665801 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:31.667714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:31.736133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:31.743581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0801146-912b-4a8d-8b31-eb9850763889 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:31.751023 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:31.751935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:31.752319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:31.752701 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:31.763736 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:31.765329 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:31.776217 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1221/2461] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:32.553960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6c642-7ac9-4b73-ad36-9c087191cb32 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:32.555237 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6c642-7ac9-4b73-ad36-9c087191cb32 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:32.555742 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6c642-7ac9-4b73-ad36-9c087191cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:32.597026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b3d6c642-7ac9-4b73-ad36-9c087191cb32 None None] MFA Rules not processed for user `46a80c877b094c489f092fd467b229fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:32.599310 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b3d6c642-7ac9-4b73-ad36-9c087191cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:32.675999 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:32.711856 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1241/2462] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:32.713135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:32.723938 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc595e1-2478-46ac-993d-aa405339bfe3 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:32.729426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:32.730325 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:32.730842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:32.731431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:32.732383 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:32.734727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:32.770974 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1222/2463] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:32 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:32.775005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6c642-7ac9-4b73-ad36-9c087191cb32 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:32.788685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6c642-7ac9-4b73-ad36-9c087191cb32 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:32.874353 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:32.875604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:32.875890 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:32.876179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:32.876852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:32.879001 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:32.904380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1242/2464] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:32 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:32.908188 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:32.919670 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b9f42-8a97-4702-84cb-55081dd6a4b9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:32.925221 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:32.925930 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:32.926313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:32.926703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:32.927423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:32.929133 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:32.942129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1223/2465] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:32.946033 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:32.960784 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b7af-0c13-48fb-93c9-8282aa91c045 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:32.966267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:32.966884 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:32.967169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:32.967447 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] PATH_INFO: `/v3/projects/8fffad6ff60d41fe908d8152582f2748/users/deea3aea7bf7436680cea9ed4b085b25/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:32.986297 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fffad6ff60d41fe908d8152582f2748, user_id=deea3aea7bf7436680cea9ed4b085b25, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:32.988990 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:33.018963 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1243/2466] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:32 2022] PUT /identity/v3/projects/8fffad6ff60d41fe908d8152582f2748/users/deea3aea7bf7436680cea9ed4b085b25/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:33.023242 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:33.037693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367d92b-de96-4dbd-9b59-21178454d38b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:33.110170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c2cd-d056-494c-a77a-48ffcebfa482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:33.110847 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c2cd-d056-494c-a77a-48ffcebfa482 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:33.111129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c2cd-d056-494c-a77a-48ffcebfa482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:33.111399 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c2cd-d056-494c-a77a-48ffcebfa482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:33.112123 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0c2cd-d056-494c-a77a-48ffcebfa482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:33.113812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0c2cd-d056-494c-a77a-48ffcebfa482 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:33.124581 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1224/2467] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:33.128787 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:33.139559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3582e8-4016-464c-a305-86fd975497fd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:33.145041 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:33.145691 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:33.145966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:33.146274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] PATH_INFO: `/v3/projects/8fffad6ff60d41fe908d8152582f2748/users/deea3aea7bf7436680cea9ed4b085b25/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:33.148511 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fffad6ff60d41fe908d8152582f2748, user_id=deea3aea7bf7436680cea9ed4b085b25, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:33.151450 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:33.167080 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1244/2468] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:33 2022] PUT /identity/v3/projects/8fffad6ff60d41fe908d8152582f2748/users/deea3aea7bf7436680cea9ed4b085b25/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:33.316758 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108befb-8652-4e2b-ac35-8a7db774ac84 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:33.317048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108befb-8652-4e2b-ac35-8a7db774ac84 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:33.317321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108befb-8652-4e2b-ac35-8a7db774ac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:33.339207 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0108befb-8652-4e2b-ac35-8a7db774ac84 None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:33.340810 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0108befb-8652-4e2b-ac35-8a7db774ac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:33.421095 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1225/2469] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:12:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:33.434951 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:33.436760 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:33.527499 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3a11-03d6-4e34-a3e1-1dd2d1d5b17c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:33.533575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55829ed-022b-414b-bb70-71e512567a18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:33.534293 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55829ed-022b-414b-bb70-71e512567a18 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:33.534765 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55829ed-022b-414b-bb70-71e512567a18 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:33.534975 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55829ed-022b-414b-bb70-71e512567a18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:33.545341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55829ed-022b-414b-bb70-71e512567a18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:33.547644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55829ed-022b-414b-bb70-71e512567a18 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:33.556933 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1245/2470] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:12:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:33.873070 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:33.873577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:33.873699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:33.912549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] MFA Rules not processed for user `deea3aea7bf7436680cea9ed4b085b25`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:33.914013 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:33.970254 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:34.006130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1226/2471] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:34.016716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a3b1-12d2-4df9-956a-5ebbddb79a6b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.016963 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a3b1-12d2-4df9-956a-5ebbddb79a6b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.017316 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a3b1-12d2-4df9-956a-5ebbddb79a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.045183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-79a0a3b1-12d2-4df9-956a-5ebbddb79a6b None None] MFA Rules not processed for user `46a80c877b094c489f092fd467b229fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:34.046609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-79a0a3b1-12d2-4df9-956a-5ebbddb79a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:34.082111 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:34.132572 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1246/2472] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:34.146619 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:34.148049 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:34.151698 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61db9d-e460-4794-892a-a898637c7afb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.152097 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61db9d-e460-4794-892a-a898637c7afb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.152493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61db9d-e460-4794-892a-a898637c7afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.178945 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9f61db9d-e460-4794-892a-a898637c7afb None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:34.180199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9f61db9d-e460-4794-892a-a898637c7afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:34.188456 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1247/2473] 10.222.0.18 () {58 vars in 967 bytes} [Sun Oct 23 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:34.201504 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61db9d-e460-4794-892a-a898637c7afb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:34.216251 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61db9d-e460-4794-892a-a898637c7afb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:34.224822 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3549b-b9b3-4efc-9c8e-93cabe949213 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:34.225546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3549b-b9b3-4efc-9c8e-93cabe949213 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.225906 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3549b-b9b3-4efc-9c8e-93cabe949213 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.226285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3549b-b9b3-4efc-9c8e-93cabe949213 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.239427 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3549b-b9b3-4efc-9c8e-93cabe949213 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:34.240439 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395d090-a39c-4913-8fe6-78924a1acb4d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:34.241049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3549b-b9b3-4efc-9c8e-93cabe949213 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:34.246664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:34.247100 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.247393 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.247769 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.253372 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1248/2474] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 20:12:34.256725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:34.258189 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:34.268569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1227/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:34.501759 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965b33-f40e-48da-996e-922d7ef6b4be None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.502027 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965b33-f40e-48da-996e-922d7ef6b4be None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.502336 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965b33-f40e-48da-996e-922d7ef6b4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.522578 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-32965b33-f40e-48da-996e-922d7ef6b4be None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:34.523707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-32965b33-f40e-48da-996e-922d7ef6b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:34.530887 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1249/2476] 10.222.0.18 () {58 vars in 967 bytes} [Sun Oct 23 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:34.543191 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:34.555026 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38239b3-4ef8-4ba7-971d-0fb1972893ed service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:34.560102 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:34.560752 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.561025 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.561298 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.570989 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:34.572558 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:34.580658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1228/2477] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:34.904790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c33b32-dba8-481e-8d1b-dfd41ef76e0d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.905392 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c33b32-dba8-481e-8d1b-dfd41ef76e0d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.905685 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c33b32-dba8-481e-8d1b-dfd41ef76e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.928705 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e9c33b32-dba8-481e-8d1b-dfd41ef76e0d None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:34.930109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e9c33b32-dba8-481e-8d1b-dfd41ef76e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:34.942221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1250/2478] 10.222.0.18 () {58 vars in 1009 bytes} [Sun Oct 23 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:12:34.957775 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:34.977107 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8362-8e5c-4aff-8526-a9badc4dafb5 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:34.983048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:34.983735 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:34.984091 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:34.985034 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:34.996798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:34.998800 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:35.007957 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1229/2479] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 20:12:35.377139 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:35.377424 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:35.377699 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:35.404024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] MFA Rules not processed for user `822b518d691f4c0fa54e2bc41144ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:35.405238 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:35.413173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1251/2480] 10.222.0.18 () {58 vars in 967 bytes} [Sun Oct 23 20:12:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:35.426216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:35.437219 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f2056-0aa4-4fd5-bb14-8e2c474c66c6 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:35.443322 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ddd37ebc3874a8f8a8d60c0a32bf090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:35.443990 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:35.444335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:35.444676 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:35.454447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:35.456044 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:35.466108 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1230/2481] 10.222.0.18 () {60 vars in 1384 bytes} [Sun Oct 23 20:12:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 20:12:36.648998 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:36.650548 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:36.764026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e70e0-de2b-4ba1-934e-0b9db94cb73f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:36.770132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:36.770880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:36.771227 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:36.771561 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] PATH_INFO: `/v3/users/8311284f41b34cb5a162fc850e73ad18` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:36.772821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8311284f41b34cb5a162fc850e73ad18)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:36.774870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:36.845283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8311284f41b34cb5a162fc850e73ad18'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:36.858983 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8311284f41b34cb5a162fc850e73ad18'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:36.860350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8311284f41b34cb5a162fc850e73ad18'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:36.860932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8311284f41b34cb5a162fc850e73ad18'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:36.872312 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-72eb8f86-a50c-4d6d-b16a-5d3d98064aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8311284f41b34cb5a162fc850e73ad18'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:36.889597 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1252/2482] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:36 2022] DELETE /identity/v3/users/8311284f41b34cb5a162fc850e73ad18 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:37.071936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.085965 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73cfef-e8d3-41e8-82be-41b61cc74a7f service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.147054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.147714 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.147998 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.148274 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] PATH_INFO: `/v3/projects/78f14cfb202b4b1f8ec7c97320d134e8` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.149413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f14cfb202b4b1f8ec7c97320d134e8)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.151344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.187786 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:37.202160 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f14cfb202b4b1f8ec7c97320d134e8', 'request_id': 'req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.209237 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f14cfb202b4b1f8ec7c97320d134e8', 'request_id': 'req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.217323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f14cfb202b4b1f8ec7c97320d134e8', 'request_id': 'req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.229277 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] The token cache is being invalidate because project 78f14cfb202b4b1f8ec7c97320d134e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:37.229575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.230265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-4c70a3aa-7ba8-421e-a714-dbcc3e5cc0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.231784 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1231/2483] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:37 2022] DELETE /identity/v3/projects/78f14cfb202b4b1f8ec7c97320d134e8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:37.236658 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ef159-4a12-430a-b7b3-3688e01d4ed3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.236948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ef159-4a12-430a-b7b3-3688e01d4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.237221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ef159-4a12-430a-b7b3-3688e01d4ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.257642 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-021ef159-4a12-430a-b7b3-3688e01d4ed3 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:37.259212 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-021ef159-4a12-430a-b7b3-3688e01d4ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:37.271527 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:37.332322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1253/2484] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:37.339830 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6c97-37da-476c-a9d9-cf9fdf1a5050 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.340126 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6c97-37da-476c-a9d9-cf9fdf1a5050 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.340403 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f6c97-37da-476c-a9d9-cf9fdf1a5050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.362099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-741f6c97-37da-476c-a9d9-cf9fdf1a5050 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:37.363365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-741f6c97-37da-476c-a9d9-cf9fdf1a5050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:37.372777 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1232/2485] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:37.377778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ef159-4a12-430a-b7b3-3688e01d4ed3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.387567 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ef159-4a12-430a-b7b3-3688e01d4ed3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.392836 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.393431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.394318 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.394593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.395241 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:12:37.395539 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.397122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.412243 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1254/2486] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:12:37.413465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f6c97-37da-476c-a9d9-cf9fdf1a5050 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.423115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f6c97-37da-476c-a9d9-cf9fdf1a5050 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.428323 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.428929 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.429211 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.429608 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.430472 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.432367 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.464038 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1233/2487] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:12:37 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:12:37.465228 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.476044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f161fd-f68b-4a24-be2a-402685f24a34 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.533881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.534517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.534801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.535076 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.535716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.537638 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.559729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1255/2488] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:12:37 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:12:37.564943 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.575493 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ff54-56dd-48f1-bb70-411e4a8d8551 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.581233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.581841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.582199 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.582471 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.583114 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.584755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.595610 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1234/2489] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:12:37.600007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.611470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4411-ee76-4db3-88b6-9106c48f7c2d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.616710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b3f53-2082-46ed-a497-ca72d01bda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.617328 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b3f53-2082-46ed-a497-ca72d01bda7a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.617595 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b3f53-2082-46ed-a497-ca72d01bda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.617867 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b3f53-2082-46ed-a497-ca72d01bda7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.618553 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b3f53-2082-46ed-a497-ca72d01bda7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.620188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b3f53-2082-46ed-a497-ca72d01bda7a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.632102 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1256/2490] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:12:37.636526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.646987 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cac569-93b5-42fb-84df-83d508bbb34a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.652348 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.652932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.653625 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.653915 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] PATH_INFO: `/v3/projects/235201dd709349978839a93d0e53c9c0/users/a8a3e96437954bbf8f2d4a6478a694a3/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.670410 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=235201dd709349978839a93d0e53c9c0, user_id=a8a3e96437954bbf8f2d4a6478a694a3, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.676011 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.693447 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1235/2491] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:12:37 2022] PUT /identity/v3/projects/235201dd709349978839a93d0e53c9c0/users/a8a3e96437954bbf8f2d4a6478a694a3/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:12:37.707529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.707529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.707529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.742179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] MFA Rules not processed for user `a8a3e96437954bbf8f2d4a6478a694a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:37.742984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.743659 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:37.745320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:37.829021 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1257/2492] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:37.831116 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df8a82-21ad-46bc-a030-4fecd510c16c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.836747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.837553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.837848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.838150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] PATH_INFO: `/v3/users/92587ece6ea34dbab5e3d39f925345b0` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.839621 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92587ece6ea34dbab5e3d39f925345b0)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.843085 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.844644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:37.847201 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:37.870362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:37.908391 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92587ece6ea34dbab5e3d39f925345b0'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.917137 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92587ece6ea34dbab5e3d39f925345b0'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.919098 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:37.929398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0a04c-3501-45dd-a7ad-4b4bacfefe84 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:37.936213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92587ece6ea34dbab5e3d39f925345b0'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.937545 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92587ece6ea34dbab5e3d39f925345b0'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.938899 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:37.939524 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.941330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.941652 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.943792 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:37.953675 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-11491625-3979-4437-b097-283ef7b0b8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92587ece6ea34dbab5e3d39f925345b0'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:37.956648 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:37.958115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:37.960384 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1236/2493] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:37 2022] DELETE /identity/v3/users/92587ece6ea34dbab5e3d39f925345b0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:37.964726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:37.965304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:37.965756 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:37.967287 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1258/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:12:37.994263 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:37.995947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:38.077498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1237/2495] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:12:38.091279 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:38.092748 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:38.171274 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96eb09-d9c9-461e-b690-a6def3be407d service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:38.286519 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01acdeb-13d9-4be9-be7e-7b6749473235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:38.287397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01acdeb-13d9-4be9-be7e-7b6749473235 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:38.287833 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01acdeb-13d9-4be9-be7e-7b6749473235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:38.288387 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01acdeb-13d9-4be9-be7e-7b6749473235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:38.299391 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01acdeb-13d9-4be9-be7e-7b6749473235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:38.301259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01acdeb-13d9-4be9-be7e-7b6749473235 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:38.314576 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1259/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:38.780208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:38.783473 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:38.811065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c419a8-8d58-4f05-a613-38e282eceb66 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:38.819837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:38.820561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:38.820912 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:38.821468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] PATH_INFO: `/v3/projects/8424b3c12264416789b5dccbe2d059bd` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:38.822510 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8424b3c12264416789b5dccbe2d059bd)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:38.824464 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:38.877755 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8424b3c12264416789b5dccbe2d059bd', 'request_id': 'req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:38.883910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8424b3c12264416789b5dccbe2d059bd', 'request_id': 'req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:38.892336 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8424b3c12264416789b5dccbe2d059bd', 'request_id': 'req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:38.902239 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] The token cache is being invalidate because project 8424b3c12264416789b5dccbe2d059bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:38.902529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:38.903158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:38.904629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1238/2497] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:38 2022] DELETE /identity/v3/projects/8424b3c12264416789b5dccbe2d059bd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:41.545876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:41.546503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:41.546503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:41.566051 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:41.567267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:41.627344 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1260/2498] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:41.643032 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:41.644426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:41.700481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:41.720523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c3cb-fc8f-4a7e-95b8-bd5d28c00565 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:41.725827 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc05ab6-a96b-4507-aca8-2902a55d7d0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:41.726460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc05ab6-a96b-4507-aca8-2902a55d7d0b service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:41.726743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc05ab6-a96b-4507-aca8-2902a55d7d0b service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:41.727017 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc05ab6-a96b-4507-aca8-2902a55d7d0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:41.736802 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc05ab6-a96b-4507-aca8-2902a55d7d0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:41.738760 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc05ab6-a96b-4507-aca8-2902a55d7d0b service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:41.748469 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1239/2499] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:43.126801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:43.128266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:43.140556 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e2836-dda2-4645-a2d2-366f58ef7d57 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:43.145495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:43.146163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:43.146981 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:43.147271 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] PATH_INFO: `/v3/users/a8a3e96437954bbf8f2d4a6478a694a3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:43.148435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a3e96437954bbf8f2d4a6478a694a3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:43.150380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:43.158103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:43.203100 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a3e96437954bbf8f2d4a6478a694a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.216488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a3e96437954bbf8f2d4a6478a694a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.217286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a3e96437954bbf8f2d4a6478a694a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.217956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a3e96437954bbf8f2d4a6478a694a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.226656 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a3e96437954bbf8f2d4a6478a694a3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.240640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1261/2500] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:12:43 2022] DELETE /identity/v3/users/a8a3e96437954bbf8f2d4a6478a694a3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:43.245481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:43.245967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:43.246058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:43.265218 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:43.266465 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:43.331954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1240/2501] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:43.341162 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:43.342671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:43.401844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5e4d5-f2c2-411e-bfbf-1ad73baa0fd1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:43.405528 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9f6b0-f26d-4844-ba52-51592c1c7ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:43.406690 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9f6b0-f26d-4844-ba52-51592c1c7ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:43.406970 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9f6b0-f26d-4844-ba52-51592c1c7ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:43.407239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9f6b0-f26d-4844-ba52-51592c1c7ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:43.416074 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9f6b0-f26d-4844-ba52-51592c1c7ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:43.417484 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9f6b0-f26d-4844-ba52-51592c1c7ce8 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:43.427673 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1262/2502] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:43.690481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:43.691984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:43.705637 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dd9b4-560d-4663-8eb5-c4ed5dd544da None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:43.711774 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:43.712664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:43.713248 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:43.713618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] PATH_INFO: `/v3/projects/235201dd709349978839a93d0e53c9c0` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:43.715212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235201dd709349978839a93d0e53c9c0)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:43.717664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:43.764824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235201dd709349978839a93d0e53c9c0', 'request_id': 'req-c08efddb-77a5-465a-ace0-94a9864f5516'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.770959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235201dd709349978839a93d0e53c9c0', 'request_id': 'req-c08efddb-77a5-465a-ace0-94a9864f5516'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.778149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235201dd709349978839a93d0e53c9c0', 'request_id': 'req-c08efddb-77a5-465a-ace0-94a9864f5516'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.788640 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] The token cache is being invalidate because project 235201dd709349978839a93d0e53c9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:12:43.788935 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.789570 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:12:43.791146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1241/2503] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:12:43 2022] DELETE /identity/v3/projects/235201dd709349978839a93d0e53c9c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:12:44.610434 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:44.610844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:44.611004 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:44.630852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:44.632032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:44.691406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1263/2504] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:44.710588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:44.711997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:44.788978 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:44.793818 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efddb-77a5-465a-ace0-94a9864f5516 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:44.802129 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d236911-cdeb-4704-9dd8-e46d5ac01a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:44.802740 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236911-cdeb-4704-9dd8-e46d5ac01a18 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:44.803567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236911-cdeb-4704-9dd8-e46d5ac01a18 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:44.803567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d236911-cdeb-4704-9dd8-e46d5ac01a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:44.811893 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d236911-cdeb-4704-9dd8-e46d5ac01a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:44.814876 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d236911-cdeb-4704-9dd8-e46d5ac01a18 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:44.824639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1242/2505] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:46.937385 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:46.939272 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:46.969952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:12:46.998559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939e84-19b0-4c69-8cac-bf447fa5fee7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:47.002311 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:47.002924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:47.003190 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:47.003461 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:47.005176 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:47.067437 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:47.068876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:47.078911 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1264/2506] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:47.874314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2b0db-6528-480d-baa3-ddc0f4d9907b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:47.875409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2b0db-6528-480d-baa3-ddc0f4d9907b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:47.875409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2b0db-6528-480d-baa3-ddc0f4d9907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:47.896460 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1ec2b0db-6528-480d-baa3-ddc0f4d9907b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:47.897959 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1ec2b0db-6528-480d-baa3-ddc0f4d9907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:47.906183 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1243/2507] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:47.920546 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:47.932895 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd484b-1e7f-490e-8f06-50332e037418 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:47.939500 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:47.940083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:47.940367 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:47.940634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:47.948912 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:47.950496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:47.960418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1265/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:52.003615 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3851c3-4fd4-4d34-b44d-84b968464e2b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:52.004115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3851c3-4fd4-4d34-b44d-84b968464e2b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:52.004213 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3851c3-4fd4-4d34-b44d-84b968464e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:52.023061 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ed3851c3-4fd4-4d34-b44d-84b968464e2b None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:52.024268 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ed3851c3-4fd4-4d34-b44d-84b968464e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:52.032095 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1244/2509] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:52.060849 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:52.063028 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:52.077730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6da67d-ba12-4113-b864-41cb9930e071 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:52.083530 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:52.084126 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:52.084406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:52.084681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:52.092793 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:52.094894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:52.104231 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1266/2510] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:55.164151 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6176-b24f-4456-a1ec-5065cbf2b569 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:55.164660 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6176-b24f-4456-a1ec-5065cbf2b569 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:55.164762 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6176-b24f-4456-a1ec-5065cbf2b569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:55.183988 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-701c6176-b24f-4456-a1ec-5065cbf2b569 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:55.185158 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-701c6176-b24f-4456-a1ec-5065cbf2b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:55.193833 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1245/2511] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:55.233213 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:55.244958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74f04f-d5c2-405d-a621-2dbc311d794e service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:55.251455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:55.252042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:55.252322 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:55.252588 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:55.260860 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:55.262441 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:55.272958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1267/2512] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:12:58.346244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:58.346750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:58.346850 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:58.367337 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:12:58.368554 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:12:58.376976 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1246/2513] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:12:58.395010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:12:58.406334 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20dabd-3a3e-4f26-b0d1-f0183b40997f service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:12:58.411764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:12:58.412384 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:12:58.412663 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:12:58.412935 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:12:58.420959 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:12:58.422575 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:12:58.431764 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1268/2514] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:06.911301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:06.912832 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:06.924975 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f114-e6da-46a0-b2cc-a3afdeedc77d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:06.929500 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:06.930150 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:06.930435 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:06.930712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] PATH_INFO: `/v3/users/46a80c877b094c489f092fd467b229fe` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:06.931851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a80c877b094c489f092fd467b229fe)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:06.933747 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:06.980992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a80c877b094c489f092fd467b229fe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:06.987928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a80c877b094c489f092fd467b229fe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:06.995327 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a80c877b094c489f092fd467b229fe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:06.995944 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a80c877b094c489f092fd467b229fe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.008674 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a80c877b094c489f092fd467b229fe'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.014544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1247/2515] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:13:06 2022] DELETE /identity/v3/users/46a80c877b094c489f092fd467b229fe => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:07.185640 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:07.198040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2853f-c46f-4713-bb5c-4628597dd895 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:07.256388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:07.256928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:07.257211 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:07.257488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] PATH_INFO: `/v3/projects/2da5cc9f84494ff0a56c60dcff583cae` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:07.258628 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da5cc9f84494ff0a56c60dcff583cae)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:07.260543 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:07.291358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:07.307824 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da5cc9f84494ff0a56c60dcff583cae', 'request_id': 'req-74826a88-6b87-49f7-8c13-38d2f4ef573b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.314189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da5cc9f84494ff0a56c60dcff583cae', 'request_id': 'req-74826a88-6b87-49f7-8c13-38d2f4ef573b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.321267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da5cc9f84494ff0a56c60dcff583cae', 'request_id': 'req-74826a88-6b87-49f7-8c13-38d2f4ef573b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.331501 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] The token cache is being invalidate because project 2da5cc9f84494ff0a56c60dcff583cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:13:07.331790 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.332415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.333880 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1269/2516] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:13:07 2022] DELETE /identity/v3/projects/2da5cc9f84494ff0a56c60dcff583cae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:07.337954 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:07.339401 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:07.352778 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d53c-b830-4eee-9fec-7503e8fb9a1b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:07.408314 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:07.409519 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:07.409798 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:07.410073 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] PATH_INFO: `/v3/users/deea3aea7bf7436680cea9ed4b085b25` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:07.411223 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deea3aea7bf7436680cea9ed4b085b25)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:07.413124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:07.451900 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:07.459508 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deea3aea7bf7436680cea9ed4b085b25'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.467266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deea3aea7bf7436680cea9ed4b085b25'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.475056 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deea3aea7bf7436680cea9ed4b085b25'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.475694 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deea3aea7bf7436680cea9ed4b085b25'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.487654 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cc82d9a8-d929-490d-859e-eca2447c65f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deea3aea7bf7436680cea9ed4b085b25'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.493432 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1248/2517] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:13:07 2022] DELETE /identity/v3/users/deea3aea7bf7436680cea9ed4b085b25 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:07.697579 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:07.699005 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:07.713098 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826a88-6b87-49f7-8c13-38d2f4ef573b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:07.784343 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:07.785034 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:07.785341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:07.785622 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] PATH_INFO: `/v3/projects/8fffad6ff60d41fe908d8152582f2748` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:07.786781 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fffad6ff60d41fe908d8152582f2748)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:07.788994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:07.836239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fffad6ff60d41fe908d8152582f2748', 'request_id': 'req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.842398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fffad6ff60d41fe908d8152582f2748', 'request_id': 'req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.850665 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fffad6ff60d41fe908d8152582f2748', 'request_id': 'req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.861411 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] The token cache is being invalidate because project 8fffad6ff60d41fe908d8152582f2748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:13:07.861706 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.862928 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-00ba2fe7-3c35-488b-a10e-f64dee6ba65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:07.864417 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1270/2518] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:13:07 2022] DELETE /identity/v3/projects/8fffad6ff60d41fe908d8152582f2748 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:07.869374 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaba917-f1cb-403b-92d5-bbe5b0a5845e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:07.869663 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaba917-f1cb-403b-92d5-bbe5b0a5845e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:07.869940 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaba917-f1cb-403b-92d5-bbe5b0a5845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:07.890875 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0eaba917-f1cb-403b-92d5-bbe5b0a5845e None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:07.892092 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0eaba917-f1cb-403b-92d5-bbe5b0a5845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:07.952725 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1249/2519] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:13:07.961128 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142baef-9c3c-4c1d-a688-cdfc415b4819 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:07.961410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142baef-9c3c-4c1d-a688-cdfc415b4819 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:07.961683 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142baef-9c3c-4c1d-a688-cdfc415b4819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:07.981851 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4142baef-9c3c-4c1d-a688-cdfc415b4819 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:07.983029 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4142baef-9c3c-4c1d-a688-cdfc415b4819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:07.991888 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1271/2520] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:07.996721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaba917-f1cb-403b-92d5-bbe5b0a5845e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.006543 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaba917-f1cb-403b-92d5-bbe5b0a5845e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.011235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.011836 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.012115 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.012388 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.013028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:13:08.013333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.014992 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.026937 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1250/2521] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:13:08.030979 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142baef-9c3c-4c1d-a688-cdfc415b4819 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.041435 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142baef-9c3c-4c1d-a688-cdfc415b4819 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.046007 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.046641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.046920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.047189 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.047823 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.050893 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.079965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1272/2522] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:13:08 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:13:08.084167 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.094497 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b855856-0348-4f8e-a973-a9364c563ae0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.153214 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.153848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.154152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.154429 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.155062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.156961 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.180407 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1251/2523] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:13:08 2022] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:13:08.183948 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.195430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6200a-a552-4acf-be58-600d3381a1bb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.201875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.202609 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.202960 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.203302 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.204013 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.206283 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.217108 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1273/2524] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:08.221889 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.232315 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e64b5-54cb-4716-ba27-d12ae8615a96 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.237250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ebf76-7a57-4aa2-a2d2-834284963862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.237867 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ebf76-7a57-4aa2-a2d2-834284963862 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.238181 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ebf76-7a57-4aa2-a2d2-834284963862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.238455 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ebf76-7a57-4aa2-a2d2-834284963862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.239110 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ebf76-7a57-4aa2-a2d2-834284963862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.240703 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ebf76-7a57-4aa2-a2d2-834284963862 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.252247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1252/2525] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:08.256769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.267107 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7e01a-caa6-43bf-b39c-23f90078196f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.272653 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.273325 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.273605 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.273878 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] PATH_INFO: `/v3/projects/359c32fc4208491db196c1aa5a0ccd41/users/35af5c4f63304efbba7e17660c5eec8b/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.276369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:08.293298 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] RBAC: Authorizing `identity:create_grant(project_id=359c32fc4208491db196c1aa5a0ccd41, user_id=35af5c4f63304efbba7e17660c5eec8b, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.296024 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.311125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1274/2526] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:13:08 2022] PUT /identity/v3/projects/359c32fc4208491db196c1aa5a0ccd41/users/35af5c4f63304efbba7e17660c5eec8b/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:08.322727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1775b94-f97b-473e-aaa1-1f6886cef61a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.323131 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1775b94-f97b-473e-aaa1-1f6886cef61a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.323452 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1775b94-f97b-473e-aaa1-1f6886cef61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.354194 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b1775b94-f97b-473e-aaa1-1f6886cef61a None None] MFA Rules not processed for user `35af5c4f63304efbba7e17660c5eec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:08.355418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b1775b94-f97b-473e-aaa1-1f6886cef61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:08.365871 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:08.430423 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1253/2527] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:08.466330 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.468155 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:08.532093 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950b3b3-02a6-49ec-b89b-0b8cd9ca384f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.536711 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453907f-d31f-4b80-9935-e9f015dea006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.537346 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453907f-d31f-4b80-9935-e9f015dea006 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.537625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453907f-d31f-4b80-9935-e9f015dea006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.537894 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453907f-d31f-4b80-9935-e9f015dea006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.546566 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453907f-d31f-4b80-9935-e9f015dea006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.547932 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453907f-d31f-4b80-9935-e9f015dea006 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.558103 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1275/2528] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:08.574048 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1775b94-f97b-473e-aaa1-1f6886cef61a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.654618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1775b94-f97b-473e-aaa1-1f6886cef61a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.660033 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.660671 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.661066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.661226 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] PATH_INFO: `/v3/users/35af5c4f63304efbba7e17660c5eec8b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.662414 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35af5c4f63304efbba7e17660c5eec8b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.664335 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.731977 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35af5c4f63304efbba7e17660c5eec8b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:08.740289 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35af5c4f63304efbba7e17660c5eec8b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:08.748149 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35af5c4f63304efbba7e17660c5eec8b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:08.748779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35af5c4f63304efbba7e17660c5eec8b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:08.761552 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35af5c4f63304efbba7e17660c5eec8b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:08.767584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1254/2529] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:13:08 2022] DELETE /identity/v3/users/35af5c4f63304efbba7e17660c5eec8b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:08.772146 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.772439 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.772717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.794380 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:08.795626 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:08.865563 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1276/2530] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:08.891495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:08.893842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:08.928947 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:08.954066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c78df-66aa-46d7-b5a4-9d6e4270bfe8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:08.958430 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f30b0-9e9f-43f0-b470-74c22e62efe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:08.959995 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f30b0-9e9f-43f0-b470-74c22e62efe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:08.960294 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f30b0-9e9f-43f0-b470-74c22e62efe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:08.960573 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f30b0-9e9f-43f0-b470-74c22e62efe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:08.969507 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f30b0-9e9f-43f0-b470-74c22e62efe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:08.970970 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f30b0-9e9f-43f0-b470-74c22e62efe6 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:08.981117 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1255/2531] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:09.264853 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.266460 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:09.279666 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263c86b-6170-4282-b312-fb9cba40b8a8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.284415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.285054 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.285327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.285596 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] PATH_INFO: `/v3/projects/359c32fc4208491db196c1aa5a0ccd41` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.286752 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] RBAC: Authorizing `identity:delete_project(project_id=359c32fc4208491db196c1aa5a0ccd41)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.288667 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:09.339192 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359c32fc4208491db196c1aa5a0ccd41', 'request_id': 'req-bc5d08ec-5b3c-43a9-982e-1ae92215beee'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:09.345133 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359c32fc4208491db196c1aa5a0ccd41', 'request_id': 'req-bc5d08ec-5b3c-43a9-982e-1ae92215beee'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:09.352542 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359c32fc4208491db196c1aa5a0ccd41', 'request_id': 'req-bc5d08ec-5b3c-43a9-982e-1ae92215beee'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:09.362858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] The token cache is being invalidate because project 359c32fc4208491db196c1aa5a0ccd41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:13:09.363163 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:09.363848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc5d08ec-5b3c-43a9-982e-1ae92215beee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:09.365360 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1277/2532] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:13:09 2022] DELETE /identity/v3/projects/359c32fc4208491db196c1aa5a0ccd41 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:13:09.370561 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c968a-b347-405f-a4fb-aa22b78889fe None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.370848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c968a-b347-405f-a4fb-aa22b78889fe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.371124 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c968a-b347-405f-a4fb-aa22b78889fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.390637 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-615c968a-b347-405f-a4fb-aa22b78889fe None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:09.391829 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-615c968a-b347-405f-a4fb-aa22b78889fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:09.449598 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1256/2533] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:09.458225 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9c1e8-11a1-4db9-ba41-9dbc56cc74ab None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.458516 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9c1e8-11a1-4db9-ba41-9dbc56cc74ab None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.458801 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9c1e8-11a1-4db9-ba41-9dbc56cc74ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.478961 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f8d9c1e8-11a1-4db9-ba41-9dbc56cc74ab None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:09.480152 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f8d9c1e8-11a1-4db9-ba41-9dbc56cc74ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:09.488341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1278/2534] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:09.492563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c968a-b347-405f-a4fb-aa22b78889fe None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.502059 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c968a-b347-405f-a4fb-aa22b78889fe None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.507068 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.507657 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.507936 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.508208 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.508848 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:13:09.509148 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.510797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:09.522636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1257/2535] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:13:09.526804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9c1e8-11a1-4db9-ba41-9dbc56cc74ab None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.531173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:09.537956 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9c1e8-11a1-4db9-ba41-9dbc56cc74ab None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.544881 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.545478 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.545757 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.546043 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.546715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.548594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:09.575507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1279/2536] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:13:09 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:13:09.579728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.591015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74da37-326f-44a2-a166-1393a64e23aa admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.647099 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.647702 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.647985 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.648260 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.648902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.650838 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:09.672625 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1258/2537] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:13:09 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:13:09.677814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.688109 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d03cf1-2505-4226-a63c-6052ffde9fd7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.694603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.695206 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.695465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.695753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.696362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.697930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:09.708554 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1280/2538] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:09.712606 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.722685 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af595be-a4c4-4b92-9045-4740aaff8ced admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.727426 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a7f83-7e29-4a7f-a969-5b84591fbba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.728016 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7f83-7e29-4a7f-a969-5b84591fbba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.728297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7f83-7e29-4a7f-a969-5b84591fbba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.728574 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7f83-7e29-4a7f-a969-5b84591fbba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.729216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7f83-7e29-4a7f-a969-5b84591fbba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.730842 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7f83-7e29-4a7f-a969-5b84591fbba4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:09.742949 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1259/2539] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:09.747240 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.758260 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc0d2-ef10-40b4-b632-1d8c2337a773 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.762821 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.763462 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.763746 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.764032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] PATH_INFO: `/v3/projects/17ca467e88d24456b6c23cd9cc460fee/users/70f55b9fe6a746a8b903450ff3832d96/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.778422 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ca467e88d24456b6c23cd9cc460fee, user_id=70f55b9fe6a746a8b903450ff3832d96, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.781047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:09.793898 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1281/2540] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:13:09 2022] PUT /identity/v3/projects/17ca467e88d24456b6c23cd9cc460fee/users/70f55b9fe6a746a8b903450ff3832d96/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:09.805705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f56b-9969-4e0d-bf07-898b70edf719 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.805994 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f56b-9969-4e0d-bf07-898b70edf719 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.806313 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f56b-9969-4e0d-bf07-898b70edf719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.834577 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f1f3f56b-9969-4e0d-bf07-898b70edf719 None None] MFA Rules not processed for user `70f55b9fe6a746a8b903450ff3832d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:09.835763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f1f3f56b-9969-4e0d-bf07-898b70edf719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:09.864540 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:09.900953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1260/2541] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:09.905369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:09.973188 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58562e93-3dfe-45dc-870a-72c0a1d3a9bd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:09.977952 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:09.978766 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:09.979048 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:09.979327 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:09.979964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:09.981865 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:10.011488 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1282/2542] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:13:10.015584 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f56b-9969-4e0d-bf07-898b70edf719 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:10.027306 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f56b-9969-4e0d-bf07-898b70edf719 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:10.087353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:10.088076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:10.088343 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:10.088612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:10.089241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:10.091526 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:10.122135 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1261/2543] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:13:10 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 20:13:10.125541 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:10.137905 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a0833-c12b-48b8-8142-23646228f288 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:10.143369 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:10.144169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:10.144451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:10.144835 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:10.145487 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:10.147175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:10.158208 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1283/2544] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:10.163362 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:10.173588 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8f95c-dc52-4fce-bf42-7d2a22d28dea admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:10.179076 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:10.179730 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:10.180014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:10.180292 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] PATH_INFO: `/v3/projects/87d87f3958cc4a7f9c39c8637834c0a8/users/673342c112d74f3cbee408e0e93e2d27/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:10.195087 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d87f3958cc4a7f9c39c8637834c0a8, user_id=673342c112d74f3cbee408e0e93e2d27, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:10.197729 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:10.211564 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1262/2545] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:13:10 2022] PUT /identity/v3/projects/87d87f3958cc4a7f9c39c8637834c0a8/users/673342c112d74f3cbee408e0e93e2d27/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:10.215521 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:10.226119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bd1e-31f7-48bb-b2b3-6a7ee1460cfe admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:10.282545 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897d5da-0d50-4b99-a74f-2e2fb93e69f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:10.283199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d5da-0d50-4b99-a74f-2e2fb93e69f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:10.283415 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d5da-0d50-4b99-a74f-2e2fb93e69f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:10.284216 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d5da-0d50-4b99-a74f-2e2fb93e69f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:10.284965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897d5da-0d50-4b99-a74f-2e2fb93e69f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:10.286619 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897d5da-0d50-4b99-a74f-2e2fb93e69f9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:10.296483 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1284/2546] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:10.301309 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:10.312639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feff16-4132-4f3a-912f-1afca36d5376 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:10.318707 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:10.319409 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:10.319690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:10.320097 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] PATH_INFO: `/v3/projects/87d87f3958cc4a7f9c39c8637834c0a8/users/673342c112d74f3cbee408e0e93e2d27/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:10.322216 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d87f3958cc4a7f9c39c8637834c0a8, user_id=673342c112d74f3cbee408e0e93e2d27, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:10.324845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:10.335241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1263/2547] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:13:10 2022] PUT /identity/v3/projects/87d87f3958cc4a7f9c39c8637834c0a8/users/673342c112d74f3cbee408e0e93e2d27/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:10.399734 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056653f0-0ca1-4fa0-8309-121e930dfb1a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:10.399950 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056653f0-0ca1-4fa0-8309-121e930dfb1a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:10.400244 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056653f0-0ca1-4fa0-8309-121e930dfb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:10.429717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-056653f0-0ca1-4fa0-8309-121e930dfb1a None None] MFA Rules not processed for user `673342c112d74f3cbee408e0e93e2d27`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:10.430995 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-056653f0-0ca1-4fa0-8309-121e930dfb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:10.434940 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:10.500582 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1285/2548] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:10.511844 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:10.513557 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:10.570855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669989e-71d8-485b-ae95-1160d470b3e5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:10.574480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264b41-f890-4409-bc27-d746f32eeaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '201521dc87e544c0afcee0f7a7d0af7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:10.575079 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264b41-f890-4409-bc27-d746f32eeaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:10.575360 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264b41-f890-4409-bc27-d746f32eeaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:10.575634 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264b41-f890-4409-bc27-d746f32eeaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:10.609706 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:10.634018 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264b41-f890-4409-bc27-d746f32eeaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:10.635477 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264b41-f890-4409-bc27-d746f32eeaa4 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:10.644708 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1264/2549] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:13.169355 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056653f0-0ca1-4fa0-8309-121e930dfb1a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:13.230529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056653f0-0ca1-4fa0-8309-121e930dfb1a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:13.235235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:13.235863 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:13.236151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:13.236425 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] PATH_INFO: `/v3/users/70f55b9fe6a746a8b903450ff3832d96` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:13.238158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f55b9fe6a746a8b903450ff3832d96)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:13.240088 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:13.285458 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f55b9fe6a746a8b903450ff3832d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.297197 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f55b9fe6a746a8b903450ff3832d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.297876 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f55b9fe6a746a8b903450ff3832d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.298517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f55b9fe6a746a8b903450ff3832d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.306324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f55b9fe6a746a8b903450ff3832d96'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.319233 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1286/2550] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:13:13 2022] DELETE /identity/v3/users/70f55b9fe6a746a8b903450ff3832d96 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:13.323851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1541-cdfa-4e45-878d-245138c72066 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:13.324304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1541-cdfa-4e45-878d-245138c72066 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:13.324420 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1541-cdfa-4e45-878d-245138c72066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:13.343164 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-12af1541-cdfa-4e45-878d-245138c72066 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:13.344370 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-12af1541-cdfa-4e45-878d-245138c72066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:13.404212 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1265/2551] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:13.414604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:13.415991 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:13.437645 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:13.475451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba62e5-39f7-4a9a-8f6f-59b25bc592e6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:13.479086 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:13.479695 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:13.479966 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:13.480239 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:13.489064 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:13.490517 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:13.499732 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1287/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:13.606232 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd49f8e-34ee-463e-b364-51808a8ff2a9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:13.606797 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd49f8e-34ee-463e-b364-51808a8ff2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:13.607320 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd49f8e-34ee-463e-b364-51808a8ff2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:13.627356 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fcd49f8e-34ee-463e-b364-51808a8ff2a9 None None] MFA Rules not processed for user `9a02de1dfece4fdaadf9f6e7d60d1b01`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:13.628642 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fcd49f8e-34ee-463e-b364-51808a8ff2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:13.687809 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1266/2553] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:13.819859 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:13.821537 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:13.835869 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cd9cf-352c-4fb7-91be-b3069c21e178 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:13.841382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:13.842313 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:13.842593 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:13.842875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] PATH_INFO: `/v3/projects/17ca467e88d24456b6c23cd9cc460fee` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:13.844039 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ca467e88d24456b6c23cd9cc460fee)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:13.846026 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:13.900443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ca467e88d24456b6c23cd9cc460fee', 'request_id': 'req-40ebd97c-2625-44d5-8d10-6bf8850d1972'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.906451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ca467e88d24456b6c23cd9cc460fee', 'request_id': 'req-40ebd97c-2625-44d5-8d10-6bf8850d1972'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.914804 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ca467e88d24456b6c23cd9cc460fee', 'request_id': 'req-40ebd97c-2625-44d5-8d10-6bf8850d1972'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.925679 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] The token cache is being invalidate because project 17ca467e88d24456b6c23cd9cc460fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:13:13.925974 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.926644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:13.928121 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1288/2554] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:13:13 2022] DELETE /identity/v3/projects/17ca467e88d24456b6c23cd9cc460fee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:13.932247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd49f8e-34ee-463e-b364-51808a8ff2a9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:13.944318 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd49f8e-34ee-463e-b364-51808a8ff2a9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.001811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.002498 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.002781 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.003553 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] PATH_INFO: `/v3/users/673342c112d74f3cbee408e0e93e2d27` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.004967 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=673342c112d74f3cbee408e0e93e2d27)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:14.006953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:14.031066 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:14.056699 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673342c112d74f3cbee408e0e93e2d27'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.063993 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673342c112d74f3cbee408e0e93e2d27'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.072236 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673342c112d74f3cbee408e0e93e2d27'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.072855 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673342c112d74f3cbee408e0e93e2d27'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.088824 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cd5604e3-da27-496d-b610-610559e4cde5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673342c112d74f3cbee408e0e93e2d27'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.094868 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1267/2555] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:13:13 2022] DELETE /identity/v3/users/673342c112d74f3cbee408e0e93e2d27 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 20:13:14.405700 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:14.407259 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:14.423388 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebd97c-2625-44d5-8d10-6bf8850d1972 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.485418 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.486049 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.486465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.486611 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] PATH_INFO: `/v3/projects/87d87f3958cc4a7f9c39c8637834c0a8` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.488769 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d87f3958cc4a7f9c39c8637834c0a8)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:14.490493 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:14.536266 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:14.537724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d87f3958cc4a7f9c39c8637834c0a8', 'request_id': 'req-8cd962fb-6143-4dd6-b36c-9a706e816a6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.545234 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d87f3958cc4a7f9c39c8637834c0a8', 'request_id': 'req-8cd962fb-6143-4dd6-b36c-9a706e816a6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.554594 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d87f3958cc4a7f9c39c8637834c0a8', 'request_id': 'req-8cd962fb-6143-4dd6-b36c-9a706e816a6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.569459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] The token cache is being invalidate because project 87d87f3958cc4a7f9c39c8637834c0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:13:14.570020 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.570808 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8cd962fb-6143-4dd6-b36c-9a706e816a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:14.572992 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1289/2556] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:13:14 2022] DELETE /identity/v3/projects/87d87f3958cc4a7f9c39c8637834c0a8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:14.578689 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44c2b-fbed-441e-85d8-54457985e407 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.579152 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44c2b-fbed-441e-85d8-54457985e407 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.579264 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed44c2b-fbed-441e-85d8-54457985e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.600347 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0ed44c2b-fbed-441e-85d8-54457985e407 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:14.601677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0ed44c2b-fbed-441e-85d8-54457985e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:14.669174 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1268/2557] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:14.677753 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b27b7-34fa-45b4-8a35-10fd9b3f19e4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.678040 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b27b7-34fa-45b4-8a35-10fd9b3f19e4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.678347 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b27b7-34fa-45b4-8a35-10fd9b3f19e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.699741 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ce0b27b7-34fa-45b4-8a35-10fd9b3f19e4 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:14.700955 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ce0b27b7-34fa-45b4-8a35-10fd9b3f19e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:14.709115 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1290/2558] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:14.713382 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44c2b-fbed-441e-85d8-54457985e407 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:14.724317 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed44c2b-fbed-441e-85d8-54457985e407 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.729132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.729811 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.730111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.730395 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.731040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:13:14.731344 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:14.732931 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:14.745958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1269/2559] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:13:14.750423 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b27b7-34fa-45b4-8a35-10fd9b3f19e4 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:14.760712 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b27b7-34fa-45b4-8a35-10fd9b3f19e4 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.765459 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.766062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.766370 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.766646 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.767275 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:14.769398 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:14.797235 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1291/2560] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:13:14 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:13:14.801882 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:14.811897 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e22f-7ee1-4092-9848-5e29011769fe admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.874632 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.875404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.875763 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.876105 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.876997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:14.880392 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:14.902972 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1270/2561] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:13:14 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:13:14.907250 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:14.918465 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc374-c293-46bd-9bdd-c1da301596a4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.923114 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.923707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.924044 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.924314 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.925498 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:14.927168 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:14.936924 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1292/2562] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:14.941813 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:14.952333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33864-e1f2-459f-8e32-4c01ec1a45fb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.957513 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994f02f-0be5-4de2-b26e-d0af7dfcc7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.958779 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f02f-0be5-4de2-b26e-d0af7dfcc7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.959134 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f02f-0be5-4de2-b26e-d0af7dfcc7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.959611 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f02f-0be5-4de2-b26e-d0af7dfcc7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:14.960333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994f02f-0be5-4de2-b26e-d0af7dfcc7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:14.962015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994f02f-0be5-4de2-b26e-d0af7dfcc7cd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:14.973321 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1271/2563] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:13:14.977512 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:14.987965 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9389b2f-edd8-4ba9-ba8c-87b5cb3feb4c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:14.993495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:14.994158 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:14.994443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:14.994779 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] PATH_INFO: `/v3/projects/4b4c370dfd9c443ab48655d40284b32f/users/456de6352375406eba44bedddb15287b/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:15.010403 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4c370dfd9c443ab48655d40284b32f, user_id=456de6352375406eba44bedddb15287b, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:15.013010 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:15.026672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1293/2564] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:13:14 2022] PUT /identity/v3/projects/4b4c370dfd9c443ab48655d40284b32f/users/456de6352375406eba44bedddb15287b/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:15.038431 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0574e-6035-48b6-b863-e5c222097ee6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:15.038772 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0574e-6035-48b6-b863-e5c222097ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:15.039051 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0574e-6035-48b6-b863-e5c222097ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:15.053565 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:15.070579 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8bc0574e-6035-48b6-b863-e5c222097ee6 None None] MFA Rules not processed for user `456de6352375406eba44bedddb15287b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:15.071776 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8bc0574e-6035-48b6-b863-e5c222097ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:15.136155 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1272/2565] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:15.147814 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:15.149482 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:15.206745 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08054e06-e5f8-4e51-a45b-f774e2ce3294 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:15.210506 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c8ca8a1b1a4cffaf64bc0840b5fd02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:15.211101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:15.211382 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:15.211660 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:15.219838 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:15.221267 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:15.230263 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1294/2566] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:25.133285 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=29 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:25.226184 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:27.732065 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b0c7-de2c-4dbb-a871-9890c337bfc9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:27.732677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b0c7-de2c-4dbb-a871-9890c337bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:27.732787 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b0c7-de2c-4dbb-a871-9890c337bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:27.753178 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3547b0c7-de2c-4dbb-a871-9890c337bfc9 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:27.754397 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3547b0c7-de2c-4dbb-a871-9890c337bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:27.811845 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1273/2567] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:27.827339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:27.828729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:27.903319 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340af4e-acd7-4ff6-bbb5-23f8eac76d8c service glance] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:27.908729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:27.909352 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:27.909629 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:27.909900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:27.918669 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:27.920221 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:27.930672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1295/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:31.013333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fac2b-bb5f-4aba-8847-792b2d5c6d68 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:31.013790 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fac2b-bb5f-4aba-8847-792b2d5c6d68 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:31.014015 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fac2b-bb5f-4aba-8847-792b2d5c6d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:31.035820 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a09fac2b-bb5f-4aba-8847-792b2d5c6d68 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:31.037170 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a09fac2b-bb5f-4aba-8847-792b2d5c6d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:31.046202 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1274/2569] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:31.067062 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:31.068585 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:31.083964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426c0e8-7cce-44aa-a8ac-3a37e911fa04 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:31.090520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:31.091117 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:31.091397 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:31.091671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:31.100341 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:31.101916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:31.111565 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1296/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:13:34.105771 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc46b-eaaf-4633-a677-0d131f4a9ee1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:34.106303 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc46b-eaaf-4633-a677-0d131f4a9ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:34.106404 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adc46b-eaaf-4633-a677-0d131f4a9ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:34.185681 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c8adc46b-eaaf-4633-a677-0d131f4a9ee1 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:34.186916 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c8adc46b-eaaf-4633-a677-0d131f4a9ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:34.237224 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1275/2571] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:34.252329 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:34.317930 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677cec7-a45e-46e9-b003-f54c807417c4 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:34.324050 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:34.324641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:34.324923 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:34.325199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:34.333256 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:34.334964 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:34.344304 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1297/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:37.241132 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895ecd-17e5-4f66-85e2-316437bc7169 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:37.241639 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895ecd-17e5-4f66-85e2-316437bc7169 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:37.241917 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0895ecd-17e5-4f66-85e2-316437bc7169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:37.263297 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e0895ecd-17e5-4f66-85e2-316437bc7169 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:37.264532 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e0895ecd-17e5-4f66-85e2-316437bc7169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:37.273172 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1276/2573] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:37.312150 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:37.324430 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7586-aef5-4b14-b76e-64f6794b8bad service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:37.329848 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea39a0-cf44-4516-a581-1c3029f518e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:37.330467 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea39a0-cf44-4516-a581-1c3029f518e0 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:37.330749 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea39a0-cf44-4516-a581-1c3029f518e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:37.331022 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea39a0-cf44-4516-a581-1c3029f518e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:37.339151 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea39a0-cf44-4516-a581-1c3029f518e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:37.340717 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea39a0-cf44-4516-a581-1c3029f518e0 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:37.350017 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1298/2574] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:37.954712 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0895ecd-17e5-4f66-85e2-316437bc7169 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:37.964351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0895ecd-17e5-4f66-85e2-316437bc7169 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:37.969358 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:37.970146 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:37.970462 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:37.970738 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] PATH_INFO: `/v3/users/456de6352375406eba44bedddb15287b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:37.972053 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456de6352375406eba44bedddb15287b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:37.974007 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:38.018437 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:38.020899 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456de6352375406eba44bedddb15287b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.029630 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456de6352375406eba44bedddb15287b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.037084 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456de6352375406eba44bedddb15287b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.037731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456de6352375406eba44bedddb15287b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.050529 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456de6352375406eba44bedddb15287b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.056928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1277/2575] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:13:37 2022] DELETE /identity/v3/users/456de6352375406eba44bedddb15287b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:38.061502 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:38.061788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:38.062061 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:38.082009 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:38.083236 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:38.130453 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:38.143671 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1299/2576] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:38.154063 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:38.155495 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:38.213705 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75b448-c1f5-4b6a-b4ba-60cce10208b9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:38.217334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da8c2-3b77-47d1-b2a5-4641be8a50ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:38.217932 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da8c2-3b77-47d1-b2a5-4641be8a50ab service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:38.218244 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da8c2-3b77-47d1-b2a5-4641be8a50ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:38.218516 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da8c2-3b77-47d1-b2a5-4641be8a50ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:38.228413 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da8c2-3b77-47d1-b2a5-4641be8a50ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:38.229825 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da8c2-3b77-47d1-b2a5-4641be8a50ab service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:38.239874 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1278/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:38.513788 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:38.515339 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:38.528451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359420dd-eb6c-4d75-9851-bd9750ebf198 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:38.533094 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:38.533720 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:38.534000 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:38.534305 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] PATH_INFO: `/v3/projects/4b4c370dfd9c443ab48655d40284b32f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:38.535442 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4c370dfd9c443ab48655d40284b32f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:38.537350 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:38.583632 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4c370dfd9c443ab48655d40284b32f', 'request_id': 'req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.590335 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4c370dfd9c443ab48655d40284b32f', 'request_id': 'req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.598286 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4c370dfd9c443ab48655d40284b32f', 'request_id': 'req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.612529 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] The token cache is being invalidate because project 4b4c370dfd9c443ab48655d40284b32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:13:38.612828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.613532 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:13:38.615092 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1300/2578] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:13:38 2022] DELETE /identity/v3/projects/4b4c370dfd9c443ab48655d40284b32f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:13:40.422649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:40.423122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:40.423240 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:40.442481 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:13:40.443677 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:40.502020 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1279/2579] 10.222.0.25 () {58 vars in 1016 bytes} [Sun Oct 23 20:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:13:40.518710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:40.520342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:40.607531 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed027-c8be-48dd-9a99-2a1a83843fb2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:40.612958 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:40.613560 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:40.613949 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:40.614254 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:40.623119 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:40.624701 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:40.634852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1301/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:49.425047 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:13:49.426486 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:49.496077 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:49.526265 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fb7e8-1a6c-4f86-a429-4e0914adfc84 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:13:49.531664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:13:49.532266 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:13:49.532546 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:13:49.532815 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:13:49.534834 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:13:49.547523 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:13:49.549111 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:13:49.559946 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1280/2581] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:13:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:13:50.629883 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:13:59.554851 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=12 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:08.536916 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:08.538920 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:08.552132 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14912e76-99de-4bef-ad00-81e1e773c1c9 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:08.557125 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:08.557754 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:08.558032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:08.558342 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] PATH_INFO: `/v3/users/9a02de1dfece4fdaadf9f6e7d60d1b01` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:08.559451 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a02de1dfece4fdaadf9f6e7d60d1b01)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:08.562358 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:08.611122 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a02de1dfece4fdaadf9f6e7d60d1b01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.623785 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a02de1dfece4fdaadf9f6e7d60d1b01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.624471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a02de1dfece4fdaadf9f6e7d60d1b01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.625083 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a02de1dfece4fdaadf9f6e7d60d1b01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.632786 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9539dcc-324f-4fcb-9381-81aee3b33fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a02de1dfece4fdaadf9f6e7d60d1b01'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.645167 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1302/2582] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:14:08 2022] DELETE /identity/v3/users/9a02de1dfece4fdaadf9f6e7d60d1b01 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:14:08.819014 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:08.829958 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4131-ebc5-4d0d-982b-0daf6ac7697e service placement] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:08.888246 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:08.889019 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:08.889305 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:08.889592 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] PATH_INFO: `/v3/projects/411e605b2ba4437baa2a8b07ef841083` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:08.890728 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411e605b2ba4437baa2a8b07ef841083)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:08.892613 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:08.938812 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411e605b2ba4437baa2a8b07ef841083', 'request_id': 'req-02bc1397-5260-4bae-95be-1e23713cf659'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.945316 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411e605b2ba4437baa2a8b07ef841083', 'request_id': 'req-02bc1397-5260-4bae-95be-1e23713cf659'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.952267 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411e605b2ba4437baa2a8b07ef841083', 'request_id': 'req-02bc1397-5260-4bae-95be-1e23713cf659'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.963333 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] The token cache is being invalidate because project 411e605b2ba4437baa2a8b07ef841083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:14:08.963629 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.964247 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-02bc1397-5260-4bae-95be-1e23713cf659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:14:08.965727 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1281/2583] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:14:08 2022] DELETE /identity/v3/projects/411e605b2ba4437baa2a8b07ef841083 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:14:08.971175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babfd5-f8c4-436b-8015-3f64a7d236de None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:08.971473 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babfd5-f8c4-436b-8015-3f64a7d236de None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:08.971809 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babfd5-f8c4-436b-8015-3f64a7d236de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:08.991900 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-17babfd5-f8c4-436b-8015-3f64a7d236de None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:14:08.993101 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17babfd5-f8c4-436b-8015-3f64a7d236de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:09.053969 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1303/2584] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:14:09.063550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ea3c-fdab-44e1-8875-607ec5a99803 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.063841 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ea3c-fdab-44e1-8875-607ec5a99803 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.064120 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ea3c-fdab-44e1-8875-607ec5a99803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.084304 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e8c0ea3c-fdab-44e1-8875-607ec5a99803 None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:14:09.085506 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e8c0ea3c-fdab-44e1-8875-607ec5a99803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:09.093984 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1282/2585] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 20:14:09.098356 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17babfd5-f8c4-436b-8015-3f64a7d236de None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:09.109285 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17babfd5-f8c4-436b-8015-3f64a7d236de None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:09.113816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:09.114431 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.114710 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.114982 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.115641 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 20:14:09.115942 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:09.117520 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:09.129063 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1304/2586] 10.222.0.18 () {58 vars in 1153 bytes} [Sun Oct 23 20:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 20:14:09.133173 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ea3c-fdab-44e1-8875-607ec5a99803 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:09.142249 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ea3c-fdab-44e1-8875-607ec5a99803 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:09.146794 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:09.147380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.147658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.147928 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.148550 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:09.150448 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:09.179745 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1283/2587] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:14:09 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:14:09.183729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:09.194470 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9bca5-7f5d-4597-a439-3944b6ba9f15 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:09.250858 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:09.251443 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.251726 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.251994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.252608 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:09.254525 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:09.262292 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:09.281179 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1305/2588] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:14:09 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:14:09.282379 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:09.292440 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29040bea-d84e-4524-8194-75728e275fac admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:09.297726 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:09.298351 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.298636 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.298910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.299544 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:09.301122 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:09.310743 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1284/2589] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:14:09.314813 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:09.324410 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50740faf-0a69-47a6-bcc5-e56edd5612ff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:09.329127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46f7bd-f803-498e-bd1e-3765f79a9a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:09.329702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f7bd-f803-498e-bd1e-3765f79a9a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.329980 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f7bd-f803-498e-bd1e-3765f79a9a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.330289 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f7bd-f803-498e-bd1e-3765f79a9a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.330918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46f7bd-f803-498e-bd1e-3765f79a9a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:09.332496 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46f7bd-f803-498e-bd1e-3765f79a9a2e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:09.344650 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1306/2590] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:14:09.348731 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:09.359089 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528fc2e-6f6c-44d1-912f-87e6a7f49537 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:09.363687 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:09.364350 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.364631 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.364908 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] PATH_INFO: `/v3/projects/1364f95e57f14daa9664625659bead24/users/296e438dac634dbdb425c2efc63790cf/roles/a1d711c0f4c7442ebc3831a3489bcd58` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.379902 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1364f95e57f14daa9664625659bead24, user_id=296e438dac634dbdb425c2efc63790cf, role_id=a1d711c0f4c7442ebc3831a3489bcd58)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:09.382575 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:09.395210 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1285/2591] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:14:09 2022] PUT /identity/v3/projects/1364f95e57f14daa9664625659bead24/users/296e438dac634dbdb425c2efc63790cf/roles/a1d711c0f4c7442ebc3831a3489bcd58 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:14:09.400183 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7ae4-9570-4be7-9c85-4cf0c2ed3c7d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.400469 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7ae4-9570-4be7-9c85-4cf0c2ed3c7d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.400739 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce7ae4-9570-4be7-9c85-4cf0c2ed3c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.420510 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-51ce7ae4-9570-4be7-9c85-4cf0c2ed3c7d None None] MFA Rules not processed for user `9ecf283756b744a0810fbf73595c6ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:14:09.421694 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-51ce7ae4-9570-4be7-9c85-4cf0c2ed3c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:09.480077 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1307/2592] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:14:09.490334 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:09.492054 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:09.522064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:09.571872 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574a4c6-b898-4ce9-a094-29ebf4bcf477 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:09.575515 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f748dc73ef7444d9382a0680e027c2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:09.576612 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:09.576952 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:09.577161 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:09.585870 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:09.587319 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:09.597241 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1286/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:14:13.540716 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31cb4-cdaa-44f5-a004-9ec9c4a2489f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:13.541257 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31cb4-cdaa-44f5-a004-9ec9c4a2489f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:13.541376 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31cb4-cdaa-44f5-a004-9ec9c4a2489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:13.573816 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-65e31cb4-cdaa-44f5-a004-9ec9c4a2489f None None] MFA Rules not processed for user `296e438dac634dbdb425c2efc63790cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:14:13.574938 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-65e31cb4-cdaa-44f5-a004-9ec9c4a2489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:13.651730 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1308/2594] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:14:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:14:13.657365 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:13.667487 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094feb5d-dfab-4051-99a3-346768a0d789 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:13.673690 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:13.674480 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:13.674764 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:13.675043 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:13.675693 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:13.677997 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:13.709040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1287/2595] 10.222.0.18 () {60 vars in 1153 bytes} [Sun Oct 23 20:14:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:14:13.713142 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e31cb4-cdaa-44f5-a004-9ec9c4a2489f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:13.725290 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e31cb4-cdaa-44f5-a004-9ec9c4a2489f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:13.784891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:13.785503 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:13.785778 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:13.786046 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:13.786714 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:13.788625 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:13.807713 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:13.816988 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1309/2596] 10.222.0.18 () {60 vars in 1144 bytes} [Sun Oct 23 20:14:13 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 20:14:13.818281 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:13.829732 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de3b6-aee3-4c53-ab3b-45390ae626d1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:13.834569 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:13.835250 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:13.835593 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:13.835955 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:13.836721 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:13.838357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:13.850418 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1288/2597] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 20:14:13.854610 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:13.865994 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50e04a-5b6c-4755-80c4-fcdd8960ba28 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:13.870835 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:13.871495 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:13.871777 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:13.872047 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] PATH_INFO: `/v3/projects/615e5572cde640d498963fae87ff30f7/users/ff23d5151eb94d3784cad7df02e7c314/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:13.889914 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615e5572cde640d498963fae87ff30f7, user_id=ff23d5151eb94d3784cad7df02e7c314, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:13.892707 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:13.907724 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1310/2598] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:14:13 2022] PUT /identity/v3/projects/615e5572cde640d498963fae87ff30f7/users/ff23d5151eb94d3784cad7df02e7c314/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:14:13.911773 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:13.922549 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224f17e-f148-447f-a3a6-bc0c08fbff8b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:13.982761 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ea043-e5fb-4506-8903-1f9bffb2ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:13.983380 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ea043-e5fb-4506-8903-1f9bffb2ffe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:13.983688 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ea043-e5fb-4506-8903-1f9bffb2ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:13.983969 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ea043-e5fb-4506-8903-1f9bffb2ffe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:13.984624 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ea043-e5fb-4506-8903-1f9bffb2ffe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:13.986275 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ea043-e5fb-4506-8903-1f9bffb2ffe6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:13.996301 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1289/2599] 10.222.0.18 () {58 vars in 1122 bytes} [Sun Oct 23 20:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 20:14:14.000636 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:14.014603 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963b57e-4a3e-4072-8ddf-688d105ec3e9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:14.019507 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25505353-7520-45ed-a209-892aba050634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:14.020175 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505353-7520-45ed-a209-892aba050634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:14.020455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505353-7520-45ed-a209-892aba050634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:14.020729 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505353-7520-45ed-a209-892aba050634 admin admin] PATH_INFO: `/v3/projects/615e5572cde640d498963fae87ff30f7/users/ff23d5151eb94d3784cad7df02e7c314/roles/33f053640f414ee688b1cbf6d6707471` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:14.022704 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25505353-7520-45ed-a209-892aba050634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615e5572cde640d498963fae87ff30f7, user_id=ff23d5151eb94d3784cad7df02e7c314, role_id=33f053640f414ee688b1cbf6d6707471)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:14.025413 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25505353-7520-45ed-a209-892aba050634 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:14.037607 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1311/2600] 10.222.0.18 () {60 vars in 1483 bytes} [Sun Oct 23 20:14:13 2022] PUT /identity/v3/projects/615e5572cde640d498963fae87ff30f7/users/ff23d5151eb94d3784cad7df02e7c314/roles/33f053640f414ee688b1cbf6d6707471 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:14:18.537939 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03cc20-1549-4234-8b3a-c8d3eb32d8d3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:18.538449 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03cc20-1549-4234-8b3a-c8d3eb32d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:18.538780 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03cc20-1549-4234-8b3a-c8d3eb32d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:18.576646 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6f03cc20-1549-4234-8b3a-c8d3eb32d8d3 None None] MFA Rules not processed for user `ff23d5151eb94d3784cad7df02e7c314`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:14:18.578040 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6f03cc20-1549-4234-8b3a-c8d3eb32d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:18.664130 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:18.677835 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1290/2601] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:14:18.692032 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25505353-7520-45ed-a209-892aba050634 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:14:18.693875 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-25505353-7520-45ed-a209-892aba050634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:18.785604 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25505353-7520-45ed-a209-892aba050634 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:14:18.791301 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '155cc268d5ef4e47bb7a16093a360ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:14:18.791917 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:18.792199 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:18.792471 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:18.854634 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:14:18.856042 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:14:18.865903 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1312/2602] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:14:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 20:14:19.893357 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51adbe-a683-4e05-836b-50312239aae4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:14:19.893863 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51adbe-a683-4e05-836b-50312239aae4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:14:19.894159 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51adbe-a683-4e05-836b-50312239aae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:14:19.914233 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8e51adbe-a683-4e05-836b-50312239aae4 None None] MFA Rules not processed for user `296e438dac634dbdb425c2efc63790cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 20:14:19.915468 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8e51adbe-a683-4e05-836b-50312239aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:14:19.923235 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1291/2603] 10.222.0.18 () {58 vars in 958 bytes} [Sun Oct 23 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 20:14:28.862070 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:14:29.908398 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:39.373321 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:15:39.444362 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad142-17ea-4c09-bff7-843dcc9c75dc service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:15:39.449577 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:15:39.450255 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:15:39.450552 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:15:39.450815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] PATH_INFO: `/v3/users/296e438dac634dbdb425c2efc63790cf` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:15:39.451934 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] RBAC: Authorizing `identity:delete_user(user_id=296e438dac634dbdb425c2efc63790cf)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:15:39.453852 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:15:39.499670 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296e438dac634dbdb425c2efc63790cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.512702 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296e438dac634dbdb425c2efc63790cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.513406 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296e438dac634dbdb425c2efc63790cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.514018 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296e438dac634dbdb425c2efc63790cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.522324 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296e438dac634dbdb425c2efc63790cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.535896 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1313/2604] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:15:39 2022] DELETE /identity/v3/users/296e438dac634dbdb425c2efc63790cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:15:39.710229 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51adbe-a683-4e05-836b-50312239aae4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:15:39.722837 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51adbe-a683-4e05-836b-50312239aae4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:15:39.779843 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:15:39.780470 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:15:39.780750 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:15:39.781028 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] PATH_INFO: `/v3/projects/1364f95e57f14daa9664625659bead24` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:15:39.782165 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1364f95e57f14daa9664625659bead24)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:15:39.784064 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:15:39.829356 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1364f95e57f14daa9664625659bead24', 'request_id': 'req-281a74a1-8122-461e-b87d-f23733143792'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.835366 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1364f95e57f14daa9664625659bead24', 'request_id': 'req-281a74a1-8122-461e-b87d-f23733143792'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.842666 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1364f95e57f14daa9664625659bead24', 'request_id': 'req-281a74a1-8122-461e-b87d-f23733143792'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.853353 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] The token cache is being invalidate because project 1364f95e57f14daa9664625659bead24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:15:39.853653 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.854424 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.856058 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1292/2605] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:15:39 2022] DELETE /identity/v3/projects/1364f95e57f14daa9664625659bead24 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:15:39.860284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:15:39.861672 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:15:39.875300 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e996-62c9-4e49-977f-71f4c616378f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:15:39.931715 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:15:39.932284 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:15:39.932559 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:15:39.932828 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] PATH_INFO: `/v3/users/ff23d5151eb94d3784cad7df02e7c314` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:15:39.933937 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff23d5151eb94d3784cad7df02e7c314)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:15:39.935870 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:15:39.956968 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:39.981844 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff23d5151eb94d3784cad7df02e7c314'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.994169 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff23d5151eb94d3784cad7df02e7c314'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.994830 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff23d5151eb94d3784cad7df02e7c314'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:39.995420 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff23d5151eb94d3784cad7df02e7c314'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:40.002455 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff23d5151eb94d3784cad7df02e7c314'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:40.014349 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1314/2606] 10.222.0.18 () {58 vars in 1224 bytes} [Sun Oct 23 20:15:39 2022] DELETE /identity/v3/users/ff23d5151eb94d3784cad7df02e7c314 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:15:40.419290 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:15:40.420821 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:15:40.434658 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a74a1-8122-461e-b87d-f23733143792 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:15:40.492664 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecf283756b744a0810fbf73595c6ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91c902e0ebe349a8bcb2a7801a9ea6fd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:15:40.493368 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:15:40.493649 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:15:40.493926 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] PATH_INFO: `/v3/projects/615e5572cde640d498963fae87ff30f7` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:15:40.495062 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=615e5572cde640d498963fae87ff30f7)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:15:40.496953 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:15:40.530767 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:40.545563 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615e5572cde640d498963fae87ff30f7', 'request_id': 'req-a33ba5ac-f4b9-4339-9b66-697f65363544'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:40.551596 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615e5572cde640d498963fae87ff30f7', 'request_id': 'req-a33ba5ac-f4b9-4339-9b66-697f65363544'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:40.559060 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615e5572cde640d498963fae87ff30f7', 'request_id': 'req-a33ba5ac-f4b9-4339-9b66-697f65363544'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:40.569618 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] The token cache is being invalidate because project 615e5572cde640d498963fae87ff30f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 20:15:40.569910 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:40.570567 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a33ba5ac-f4b9-4339-9b66-697f65363544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 20:15:40.572094 dv-cinder-862432-1-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1293/2607] 10.222.0.18 () {58 vars in 1233 bytes} [Sun Oct 23 20:15:40 2022] DELETE /identity/v3/projects/615e5572cde640d498963fae87ff30f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 20:15:50.010918 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:15:50.566684 dv-cinder-862432-1-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 20:18:51.285681 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 20:18:51.287877 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:18:51.355909 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a816f-04d1-43cf-a628-f1fce9d8fe56 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 20:18:51.413954 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea8f6-4f41-4d9d-88ad-a7f5af326390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98a263de5ee43918dcb60bc1db5d04e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5039f9cd4374d51bdd4c3e52e1edcfe', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 20:18:51.414613 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea8f6-4f41-4d9d-88ad-a7f5af326390 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 20:18:51.414897 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea8f6-4f41-4d9d-88ad-a7f5af326390 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 20:18:51.415173 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea8f6-4f41-4d9d-88ad-a7f5af326390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 20:18:51.416891 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0dfea8f6-4f41-4d9d-88ad-a7f5af326390 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 20:18:51.428644 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea8f6-4f41-4d9d-88ad-a7f5af326390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 20:18:51.430232 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfea8f6-4f41-4d9d-88ad-a7f5af326390 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 20:18:51.440127 dv-cinder-862432-1-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1315/2608] 10.222.0.18 () {60 vars in 1365 bytes} [Sun Oct 23 20:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 20:19:01.435815 dv-cinder-862432-1-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=58 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}